Nov 04 22:12:44 devstack cinder-volume[76105]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 22:12:44 devstack cinder-volume[76105]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 22:12:44 devstack cinder-volume[76105]: we strongly recommend against using it for new projects. Nov 04 22:12:44 devstack cinder-volume[76105]: If you are already using Eventlet, we recommend migrating to a different Nov 04 22:12:44 devstack cinder-volume[76105]: framework. For more detail see Nov 04 22:12:44 devstack cinder-volume[76105]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 22:12:44 devstack cinder-volume[76105]: import eventlet # noqa Nov 04 22:12:47 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:12:47 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:12:47 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:12:48 devstack cinder-volume[76105]: INFO dbcounter [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Registered counter for database cinder Nov 04 22:12:48 devstack cinder-volume[76105]: DEBUG oslo_db.sqlalchemy.engines [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:12:48 devstack cinder-volume[76105]: DEBUG dbcounter [-] [76105] Writer thread running {{(pid=76105) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:12:48 devstack cinder-volume[76105]: INFO cinder.rpc [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 22:12:48 devstack cinder-volume[76105]: INFO cinder.rpc [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 22:12:48 devstack cinder-volume[76105]: DEBUG oslo_db.sqlalchemy.engines [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:12:49 devstack cinder-volume[76105]: INFO cinder.volume.manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Determined volume DB was empty at startup. Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG cinder.volume.manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76105) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 22:12:49 devstack cinder-volume[76105]: INFO cinder.volume.manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 22:12:49 devstack cinder-volume[76105]: WARNING stevedore.named [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 22:12:49 devstack cinder-volume[76105]: WARNING castellan.key_manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:12:49 devstack cinder-volume[76105]: WARNING cinder.keymgr.conf_key_mgr [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG cinder.volume.drivers.lvm [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76105) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_concurrency.processutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76105) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_concurrency.processutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] CMD "cinder-rtstool verify" returned: 0 in 0.403s {{(pid=76105) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_db.sqlalchemy.engines [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:12:49 devstack cinder-volume[76105]: INFO cinder.rpc [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 22:12:49 devstack cinder-volume[76105]: INFO cinder.rpc [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 22:12:49 devstack cinder-volume[76105]: WARNING stevedore.named [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 22:12:49 devstack cinder-volume[76105]: WARNING castellan.key_manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:12:49 devstack cinder-volume[76105]: INFO cinder.volume.manager [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_db.sqlalchemy.engines [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:12:49 devstack cinder-volume[76105]: INFO oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Starting 1 workers Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Started child 76260 {{(pid=76105) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Full set of CONF: {{(pid=76105) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] ******************************************************************************** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Configuration options gathered from: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] ================================================================================ {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] allow_availability_zone_fallback = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] allow_compression_on_image_upload = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] allowed_direct_url_schemes = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] api_rate_limit = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] auth_strategy = keystone {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] az_cache_duration = 3600 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_availability_zone = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_host = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76260]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_stats_polling_interval = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backup_api_class = cinder.backup.api.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backup_name_template = backup-%s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backup_use_same_host = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backup_use_temp_snapshot = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] chap_password = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] chap_username = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_internal_tenant_project_id = b132f16ff7c741539e0a6c09922fd525 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_internal_tenant_user_id = f8b226a4584e40aca878ed9376a92567 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cloned_volume_same_az = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cluster = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] compression_format = gzip {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] compute_api_class = cinder.compute.nova.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] config_dir = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] config_source = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] control_exchange = openstack {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] debug = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] default_availability_zone = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] default_group_type = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] default_volume_type = lvmdriver-1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] disk_geometry = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_client_cert = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_client_cert_key = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_data_namespace = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_ssl_cert_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_ssl_cert_verify = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] driver_use_ssl = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] enable_force_upload = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] enable_new_services = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] enable_unsupported_driver = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] enforce_multipath_for_image_xfer = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] filter_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_api_insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_api_ssl_compression = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_ca_certificates_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_catalog_info = image:glance:publicURL {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_num_retries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance_request_timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] goodness_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] graceful_shutdown_timeout = 5 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] group_api_class = cinder.group.api.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] host = devstack {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_compress_on_upload = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_conversion_address_space_limit = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_conversion_cpu_limit = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_conversion_disable = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_introspection_address_space_limit = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_introspection_cpu_limit = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_upload_use_cinder_backend = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_upload_use_internal_tenant = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_volume_cache_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_volume_cache_max_count = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] image_volume_cache_max_size_gb = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] init_host_max_objects_retrieval = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] instance_format = [instance: %(uuid)s] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iscsi_target_flags = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iscsi_write_cache = on {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iser_helper = tgtadm {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iser_ip_address = 192.168.122.189 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iser_port = 3260 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_color = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_config_append = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_dir = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_options = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_rotate_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_rotate_interval_type = days {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] log_rotation_type = none {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] max_age = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] max_logfile_count = 30 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] max_logfile_size_mb = 200 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] max_over_subscription_ratio = 20.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] message_reap_interval = 86400 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] message_ttl = 2592000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] migration_create_volume_timeout_secs = 300 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] monkey_patch = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] monkey_patch_modules = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] my_ip = 192.168.122.189 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] no_snapshot_gb_quota = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] num_iser_scan_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] num_shell_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] num_volume_device_scan_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] nvmeof_conn_info_version = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] nvmet_ns_id = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] nvmet_port_id = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_max_limit = 1000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_ext_list = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_listen_port = 8776 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_use_ssl = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] osapi_volume_workers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] per_volume_size_limit = -1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] periodic_fuzzy_delay = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] periodic_interval = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] public_endpoint = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] publish_errors = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_backup_gigabytes = 1000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_backups = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_gigabytes = 1000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_groups = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_snapshots = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] quota_volumes = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] rate_limit_burst = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] rate_limit_except_level = CRITICAL {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] rate_limit_interval = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] reinit_driver_count = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] replication_device = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] report_discard_supported = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] report_interval = 120 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] reservation_clean_interval = 86400 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] reservation_expire = 86400 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] reserved_image_namespaces = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] reserved_percentage = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] rpc_response_timeout = 120 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] run_external_periodic_tasks = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] scst_target_driver = iscsi {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] scst_target_iqn_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_down_time = 720 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] shell_completion = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] snapshot_name_template = snapshot-%s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] snapshot_same_host = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] split_loggers = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] state_path = /opt/stack/data/cinder {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] storage_availability_zone = nova {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] storage_protocol = iSCSI {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] syslog_log_facility = LOG_USER {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_helper = lioadm {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_ip_address = 192.168.122.189 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_port = 3260 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_protocol = iscsi {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] target_secondary_ip_addresses = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] trace_flags = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] transport_url = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] until_refresh = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_chap_auth = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_default_quota_class = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_journal = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_json = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_multipath_for_image_xfer = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_stderr = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] use_syslog = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] verify_glance_signatures = enabled {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_api_class = cinder.volume.api.API {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_backend_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_clear = zero {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_clear_ionice = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_clear_size = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_copy_bps_limit = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_dd_blocksize = 1M {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_name_template = volume-%s {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_service_inithost_offload = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volume_usage_audit_period = month {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] zoning_mode = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_concurrency.disable_process_locking = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:49 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.auth_section = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.auth_type = password {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.auth_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.cache = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.include_service_catalog = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.interface = public {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_password = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcache_username = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.region_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.service_type = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack sudo[76264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.backend = dogpile.cache.null {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.backend_argument = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.backend_expiration_time = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.config_prefix = cache.oslo {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack sudo[76264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.debug_cache_backend = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.enable_retry_client = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.enable_socket_keepalive = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.expiration_time = 600 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.hashclient_retry_attempts = 2 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_dead_retry = 300 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_pool_maxsize = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_sasl_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.password = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.proxies = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.redis_db = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.redis_server = localhost:6379 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.retry_attempts = 2 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.retry_delay = 0.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.socket_keepalive_count = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.socket_keepalive_idle = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.socket_keepalive_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.socket_timeout = 1.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.tls_allowed_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.tls_cafile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.tls_certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.tls_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.tls_keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cache.username = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] coordination.backend_url = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.asyncio_connection = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.asyncio_slave_connection = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.backend = sqlalchemy {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.connection = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.connection_debug = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.connection_parameters = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.connection_recycle_time = 3600 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.connection_trace = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.db_inc_retry_interval = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.db_max_retries = 20 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.db_max_retry_interval = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.db_retry_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.max_overflow = 50 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.max_pool_size = 5 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.max_retries = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.mysql_wsrep_sync_wait = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.pool_timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.retry_interval = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.slave_connection = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.sqlite_synchronous = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.synchronous_reader = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] database.use_db_reconnect = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_tracing.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.connection_string = messaging:// {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.es_doc_type = notification {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.es_scroll_size = 10000 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.es_scroll_time = 2m {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.filter_error_trace = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.hmac_keys = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.sentinel_service_name = mymaster {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.socket_timeout = 0.1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.trace_requests = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler.trace_sqlalchemy = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler_jaeger.process_tags = {} {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:49 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler_jaeger.service_name_prefix = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] profiler_otlp.service_name_prefix = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.enforce_new_defaults = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.policy_default_rule = default {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.policy_file = policy.yaml {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.group = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.helper_command = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] privsep_osbrick.user = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.group = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.helper_command = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] cinder_sys_admin.user = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.auth_section = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.auth_type = password {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.cafile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.collect_timing = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.send_service_user_token = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.split_loggers = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.tls_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] service_user.tls_min_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.auth_section = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.auth_type = password {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.collect_timing = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.region_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.split_loggers = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.tls_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] glance.tls_min_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.backend_availability_zone = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.chap_password = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.chap_username = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.disk_geometry = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_client_cert = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_client_cert_key = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_data_namespace = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.driver_use_ssl = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.extra_capabilities = {} {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.filter_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.goodness_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iscsi_target_flags = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iscsi_write_cache = on {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iser_helper = tgtadm {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iser_port = 3260 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.lvm_share_target = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.lvm_type = auto {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.num_shell_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.replication_device = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.report_discard_supported = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.reserved_percentage = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_helper = tgtadm {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_port = 3260 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_protocol = iscsi {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.trace_flags = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.unique_fqdn_network = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.use_chap_auth = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_backend_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_clear = zero {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_clear_ionice = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_clear_size = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_reports.file_event_handler = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_reports.log_dir = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.backend_host = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.chap_password = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.chap_username = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.disk_geometry = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_client_cert = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.extra_capabilities = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.filter_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.goodness_function = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iser_helper = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iser_ip_address = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iser_port = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.lvm_share_target = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.lvm_type = auto {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.num_shell_tries = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.replication_device = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.report_discard_supported = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.reserved_percentage = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.scst_target_driver = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.storage_protocol = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_helper = lioadm {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_ip_address = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_port = 3260 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.trace_flags = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.use_chap_auth = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_clear = zero {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_clear_size = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] lvmdriver-1.volumes_dir = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_notifications.driver = [] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_notifications.retry = -1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] key_manager.fixed_key = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.barbican_api_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.barbican_endpoint = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.barbican_endpoint_type = public {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.barbican_region_name = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.cafile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.collect_timing = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.number_of_retries = 60 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.retry_delay = 1 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.send_service_user_token = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.split_loggers = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.tls_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.tls_min_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.verify_ssl = True {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican.verify_ssl_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.auth_section = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.auth_type = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.cafile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.certfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.collect_timing = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.insecure = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.keyfile = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.split_loggers = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.timeout = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.tls_ciphers = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] barbican_service_user.tls_min_version = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.approle_role_id = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.approle_secret_id = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.auth_method = approle {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.auth_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.kv_mountpoint = secret {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.kv_path = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.kv_version = 2 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.namespace = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.root_token_id = **** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.ssl_ca_crt_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.timeout = 60.0 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.token_file = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.token_role = None {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.use_ssl = False {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:12:50 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] ******************************************************************************** {{(pid=76105) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 22:12:50 devstack sudo[76264]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:50 devstack sudo[76271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:50 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:50 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.346s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:12:50 devstack cinder-volume[76260]: INFO cinder.brick.local_dev.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:50 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:50 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:50 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG cinder.brick.local_dev.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76260) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 22:12:50 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:50 devstack sudo[76475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:50 devstack sudo[76475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:51 devstack sudo[76475]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:51 devstack sudo[76668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:51 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:51 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:51 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:51 devstack sudo[76757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 22:12:51 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:52 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.284s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:52 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:52 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:52 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:52 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:52 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:52 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:52 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:52 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:52 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:52 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:52 devstack sudo[76970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:52 devstack sudo[76970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:53 devstack sudo[76970]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:53 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:53 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:53 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:53 devstack cinder-volume[76260]: INFO cinder.volume.drivers.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:53 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:53 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:53 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:12:53 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:53 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:53 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:54 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:54 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:54 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:54 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:54 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:54 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:54 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:54 devstack sudo[77082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:54 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:54 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:54 devstack cinder-volume[76260]: INFO cinder.volume.driver [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Driver hasn't implemented _init_vendor_properties() Nov 04 22:12:54 devstack cinder-volume[76260]: DEBUG cinder.volume.driver [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76260) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_db.sqlalchemy.engines [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writer thread running {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG cinder.db.api [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Building query based on filter {{(pid=76260) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG cinder.image.image_utils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76260) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 22:12:55 devstack cinder-volume[76260]: INFO cinder.keymgr.migration [None req-afd2140f-72c6-42fd-bdf4-bf4b2d34d849 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:55 devstack sudo[77086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:55 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:55 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:55 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:55 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:55 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:55 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:55 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:55 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:55 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:56 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:56 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:56 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG cinder.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Notifying Schedulers of capabilities ... {{(pid=76260) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:12:56 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Driver initialization completed successfully. Nov 04 22:12:56 devstack cinder-volume[76260]: INFO cinder.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Initiating service 2 cleanup Nov 04 22:12:56 devstack cinder-volume[76260]: INFO cinder.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Service 2 cleanup completed. Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG cinder.service [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Creating RPC server for service cinder-volume {{(pid=76260) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG cinder.service [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76260) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 22:12:56 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:56 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:12:56 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:56 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:56 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:56 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:56 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:56 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:56 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:12:56 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:57 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:57 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:57 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:12:57 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:12:57 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:12:57 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Nov 04 22:12:57 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:12:57 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-d8cca904-5aa0-4f3f-aedf-b6ffebc74d3c None None] Driver post RPC initialization completed successfully. Nov 04 22:12:59 devstack cinder-volume[76105]: DEBUG dbcounter [-] [76105] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76105) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:13:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:SELECT=2 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:13:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:13:23 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager._thread_info {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:13:23 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread count: 6 {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:13:23 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread info: [<_MainThread(MainThread, started 128105549381760)>, , , , , ] {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:14:23 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:14:23 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:14:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:14:23 devstack sudo[80074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:14:23 devstack sudo[80074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:14:23 devstack sudo[80074]: pam_unix(sudo:session): session closed for user root Nov 04 22:14:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:14:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:14:23 devstack sudo[80229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:14:23 devstack sudo[80229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:14:24 devstack sudo[80229]: pam_unix(sudo:session): session closed for user root Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:14:24 devstack sudo[80373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:14:24 devstack sudo[80373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:14:24 devstack sudo[80373]: pam_unix(sudo:session): session closed for user root Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:14:24 devstack sudo[80523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:14:24 devstack sudo[80523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:14:24 devstack sudo[80523]: pam_unix(sudo:session): session closed for user root Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG cinder.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Notifying Schedulers of capabilities ... {{(pid=76260) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager._thread_info {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread count: 6 {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:14:24 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread info: [<_MainThread(MainThread, started 128105549381760)>, , , , , ] {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:15:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:SELECT=1 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:15:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:UPDATE=1 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:15:23 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:15:23 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:15:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:15:23 devstack sudo[83463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:15:23 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:15:23 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root Nov 04 22:15:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:15:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:15:23 devstack sudo[83485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:15:23 devstack sudo[83485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:15:24 devstack sudo[83485]: pam_unix(sudo:session): session closed for user root Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:15:24 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:15:24 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:15:24 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:15:24 devstack sudo[83511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:15:24 devstack sudo[83511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:15:24 devstack sudo[83511]: pam_unix(sudo:session): session closed for user root Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:15:24 devstack cinder-volume[76260]: DEBUG cinder.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Notifying Schedulers of capabilities ... {{(pid=76260) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:16:23 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:16:23 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Updating volume stats {{(pid=76260) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 22:16:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:16:23 devstack sudo[85133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 22:16:23 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:16:23 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root Nov 04 22:16:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:16:23 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:16:23 devstack sudo[85137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:16:23 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:16:24 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:16:24 devstack sudo[85140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 22:16:24 devstack sudo[85140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:16:24 devstack sudo[85140]: pam_unix(sudo:session): session closed for user root Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:16:24 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 22:16:24 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:16:24 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG cinder.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Notifying Schedulers of capabilities ... {{(pid=76260) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG oslo_service.periodic_task [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] Running periodic task VolumeManager._thread_info {{(pid=76260) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread count: 6 {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:16:24 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-58f086e8-e261-4dc6-bc2c-d16df0a0ceea None None] thread info: [<_MainThread(MainThread, started 128105549381760)>, , , , , ] {{(pid=76260) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:17:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:SELECT=1 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:17:07 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:UPDATE=1 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:17:20 devstack cinder-volume[76105]: INFO oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Caught SIGTERM, stopping children Nov 04 22:17:20 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Acquiring lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:20 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Acquired lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:20 devstack cinder-volume[76105]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Releasing lock "singleton_lock" {{(pid=76105) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:20 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Stop services. {{(pid=76105) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 22:17:20 devstack cinder-volume[76105]: DEBUG oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Killing children. {{(pid=76105) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 22:17:20 devstack cinder-volume[76105]: INFO oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Waiting on 1 children to exit Nov 04 22:17:21 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Acquiring lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:21 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Acquired lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:21 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Releasing lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:21 devstack cinder-volume[76260]: WARNING amqp [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 22:17:21 devstack cinder-volume[76260]: WARNING amqp [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 22:17:21 devstack cinder-volume[76105]: INFO oslo_service.backend._eventlet.service [None req-68fde044-cd87-4f4a-9bcd-573605ed6e3f None None] Child 76260 exited with status 0 Nov 04 22:17:21 devstack cinder-volume[86293]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 22:17:21 devstack cinder-volume[86293]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 22:17:21 devstack cinder-volume[86293]: we strongly recommend against using it for new projects. Nov 04 22:17:21 devstack cinder-volume[86293]: If you are already using Eventlet, we recommend migrating to a different Nov 04 22:17:21 devstack cinder-volume[86293]: framework. For more detail see Nov 04 22:17:21 devstack cinder-volume[86293]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 22:17:21 devstack cinder-volume[86293]: import eventlet # noqa Nov 04 22:17:23 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:23 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:23 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:24 devstack cinder-volume[86293]: INFO dbcounter [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Registered counter for database cinder Nov 04 22:17:24 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:24 devstack cinder-volume[86293]: DEBUG dbcounter [-] [86293] Writer thread running {{(pid=86293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:17:24 devstack cinder-volume[86293]: INFO cinder.rpc [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 22:17:24 devstack cinder-volume[86293]: INFO cinder.rpc [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 22:17:24 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:25 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Determined volume DB was empty at startup. Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG cinder.volume.manager [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86293) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 22:17:25 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 22:17:25 devstack cinder-volume[86293]: WARNING stevedore.named [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 22:17:25 devstack cinder-volume[86293]: WARNING castellan.key_manager [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:17:25 devstack cinder-volume[86293]: WARNING cinder.keymgr.conf_key_mgr [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:17:25 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:25 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Starting 1 workers Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Started child 86511 {{(pid=86293) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Full set of CONF: {{(pid=86293) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] ******************************************************************************** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Configuration options gathered from: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] ================================================================================ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 22:17:25 devstack cinder-volume[86511]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] allow_availability_zone_fallback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] allow_compression_on_image_upload = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] allowed_direct_url_schemes = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] api_rate_limit = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] auth_strategy = keystone {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_stats_polling_interval = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backup_api_class = cinder.backup.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backup_name_template = backup-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backup_use_same_host = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backup_use_temp_snapshot = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] chap_username = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_internal_tenant_project_id = b132f16ff7c741539e0a6c09922fd525 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_internal_tenant_user_id = f8b226a4584e40aca878ed9376a92567 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cluster = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] compression_format = gzip {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] compute_api_class = cinder.compute.nova.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] config_dir = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] config_source = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] control_exchange = openstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] debug = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] default_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] default_group_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] default_volume_type = QuobyteHD {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_ssl_cert_verify = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] driver_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] enable_new_services = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] enable_unsupported_driver = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] enabled_backends = ['QuobyteHD'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] enforce_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_api_insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_api_ssl_compression = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_ca_certificates_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_catalog_info = image:glance:publicURL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_num_retries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance_request_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] graceful_shutdown_timeout = 5 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] group_api_class = cinder.group.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] host = devstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_compress_on_upload = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_conversion_address_space_limit = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_conversion_cpu_limit = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_conversion_disable = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_introspection_address_space_limit = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_introspection_cpu_limit = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_upload_use_cinder_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_upload_use_internal_tenant = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_volume_cache_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_volume_cache_max_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] image_volume_cache_max_size_gb = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] init_host_max_objects_retrieval = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] instance_format = [instance: %(uuid)s] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iscsi_target_flags = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iscsi_write_cache = on {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iser_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iser_ip_address = 192.168.122.189 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iser_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_color = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_config_append = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86511]: INFO cinder.volume.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.remotefs [None req-b9602a7c-4467-4673-be05-c70184042044 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86511) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_options = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_rotate_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_rotate_interval_type = days {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] log_rotation_type = none {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] max_age = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] max_logfile_count = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] max_logfile_size_mb = 200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] max_over_subscription_ratio = 20.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] message_reap_interval = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] message_ttl = 2592000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] migration_create_volume_timeout_secs = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] monkey_patch = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] monkey_patch_modules = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] my_ip = 192.168.122.189 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] no_snapshot_gb_quota = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] num_iser_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] num_shell_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] num_volume_device_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] nvmeof_conn_info_version = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] nvmet_ns_id = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] nvmet_port_id = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_max_limit = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_ext_list = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_listen_port = 8776 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] osapi_volume_workers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] per_volume_size_limit = -1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] periodic_fuzzy_delay = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] periodic_interval = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] public_endpoint = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] publish_errors = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_backup_gigabytes = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_backups = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_gigabytes = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_groups = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_snapshots = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] quota_volumes = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] rate_limit_burst = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] rate_limit_except_level = CRITICAL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] rate_limit_interval = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] reinit_driver_count = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] report_discard_supported = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] report_interval = 120 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] reservation_clean_interval = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] reservation_expire = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] reserved_image_namespaces = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] reserved_percentage = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] rpc_response_timeout = 120 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] run_external_periodic_tasks = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] scst_target_driver = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_down_time = 720 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] shell_completion = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] snapshot_name_template = snapshot-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] state_path = /opt/stack/data/cinder {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] storage_availability_zone = nova {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] storage_protocol = iSCSI {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] syslog_log_facility = LOG_USER {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_helper = lioadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_ip_address = 192.168.122.189 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_protocol = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] target_secondary_ip_addresses = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] transport_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] until_refresh = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_chap_auth = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_default_quota_class = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_journal = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_json = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_stderr = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] use_syslog = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] verify_glance_signatures = enabled {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_api_class = cinder.volume.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_clear = zero {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_clear_size = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_copy_bps_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_dd_blocksize = 1M {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_name_template = volume-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_service_inithost_offload = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volume_usage_audit_period = month {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] zoning_mode = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_concurrency.disable_process_locking = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.auth_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.include_service_catalog = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.interface = public {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86511) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 22:17:25 devstack cinder-volume[86511]: WARNING cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 22:17:25 devstack cinder-volume[86511]: WARNING cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Running cmd (subprocess): mount.quobyte {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcache_username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.service_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.backend = dogpile.cache.null {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.backend_argument = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.backend_expiration_time = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.config_prefix = cache.oslo {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.debug_cache_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.enable_retry_client = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.enable_socket_keepalive = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.expiration_time = 600 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.hashclient_retry_attempts = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_dead_retry = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_pool_maxsize = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_sasl_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.proxies = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.redis_db = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.redis_server = localhost:6379 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.retry_attempts = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.retry_delay = 0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.socket_keepalive_count = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.socket_keepalive_idle = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.socket_keepalive_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.socket_timeout = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.tls_allowed_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.tls_cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.tls_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.tls_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.tls_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cache.username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] coordination.backend_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.asyncio_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.asyncio_slave_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.backend = sqlalchemy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.connection_debug = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.connection_parameters = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.connection_recycle_time = 3600 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.connection_trace = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.db_inc_retry_interval = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.db_max_retries = 20 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.db_max_retry_interval = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.db_retry_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.max_overflow = 50 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.max_pool_size = 5 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.max_retries = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.mysql_wsrep_sync_wait = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.pool_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.retry_interval = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.slave_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.sqlite_synchronous = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.synchronous_reader = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] database.use_db_reconnect = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_tracing.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.connection_string = messaging:// {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.es_doc_type = notification {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.es_scroll_size = 10000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.es_scroll_time = 2m {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.filter_error_trace = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.hmac_keys = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.sentinel_service_name = mymaster {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.socket_timeout = 0.1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.trace_requests = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler.trace_sqlalchemy = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler_jaeger.process_tags = {} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler_jaeger.service_name_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] profiler_otlp.service_name_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.enforce_new_defaults = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.policy_default_rule = default {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.policy_file = policy.yaml {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.group = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.helper_command = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] privsep_osbrick.user = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.group = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.helper_command = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack quobyte-client[86520]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 22:17:25 devstack quobyte-client[86520]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=86511) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] cinder_sys_admin.user = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86511]: INFO cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 ... Nov 04 22:17:25 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 -c /etc/quobyte/client-cinder.cfg {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.send_service_user_token = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] service_user.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] glance.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.chap_username = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.driver_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.extra_capabilities = {} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iscsi_target_flags = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iscsi_write_cache = on {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iser_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iser_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_host = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_login = admin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_mount_options = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_private_key = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_share_path = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.num_shell_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.quobyte_volume_url = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.report_discard_supported = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.reserved_percentage = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 -c /etc/quobyte/client-cinder.cfg Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_protocol = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.unique_fqdn_network = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.use_chap_auth = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_clear = zero {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_clear_size = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_reports.file_event_handler = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_reports.log_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.backend_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.chap_username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.chiscsi_conf = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.driver_use_ssl = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.extra_capabilities = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iser_helper = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iser_ip_address = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iser_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.iser_target_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_login = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_mount_options = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_private_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_share_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_ssh_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.num_shell_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.nvmet_port_id = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.report_discard_supported = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.reserved_percentage = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.scst_target_driver = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.storage_protocol = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_helper = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_ip_address = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_protocol = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.use_chap_auth = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_clear = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_clear_size = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] QuobyteHD.volumes_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_notifications.driver = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_notifications.retry = -1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] key_manager.fixed_key = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.barbican_api_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.barbican_endpoint = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.barbican_endpoint_type = public {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.barbican_region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.number_of_retries = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.retry_delay = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.send_service_user_token = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.verify_ssl = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican.verify_ssl_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.auth_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] barbican_service_user.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.approle_role_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.approle_secret_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.auth_method = approle {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.auth_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.kv_mountpoint = secret {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.kv_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.kv_version = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.root_token_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.ssl_ca_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.token_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.token_role = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:25 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] ******************************************************************************** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 22:17:26 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.550s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 succeeded Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=86511) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.572s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:26 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:26 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:26 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.252s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.volume.driver [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.driver [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5663986206055, 'free_capacity_gb': 1773.5663986206055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86511) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_db.sqlalchemy.engines [None req-b9602a7c-4467-4673-be05-c70184042044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86511) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG dbcounter [-] [86511] Writer thread running {{(pid=86511) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.db.api [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Building query based on filter {{(pid=86511) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.image.image_utils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86511) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.keymgr.migration [None req-12167ba4-de9b-4a09-bb2a-ad67cb281f0d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=86511) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=86511) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:26 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:26 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:26 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.222s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Notifying Schedulers of capabilities ... {{(pid=86511) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.volume.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Driver initialization completed successfully. Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Initiating service 3 cleanup Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Service 3 cleanup completed. Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.service [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Creating RPC server for service cinder-volume {{(pid=86511) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.service [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86511) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 22:17:26 devstack cinder-volume[86511]: INFO cinder.volume.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=86511) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=86511) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:26 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:26 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:26 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:27 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:27 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-b9602a7c-4467-4673-be05-c70184042044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.238s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:27 devstack cinder-volume[86511]: INFO cinder.volume.manager [None req-b9602a7c-4467-4673-be05-c70184042044 None None] Driver post RPC initialization completed successfully. Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=86511) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG cinder.volume.drivers.quobyte [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=86511) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86511) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:31 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:31 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:31 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG oslo_concurrency.processutils [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.242s {{(pid=86511) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:31 devstack cinder-volume[86511]: DEBUG cinder.manager [None req-bb5241a8-4097-40c0-8c6c-43a5fc2d117f None None] Notifying Schedulers of capabilities ... {{(pid=86511) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:17:31 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Caught SIGTERM, stopping children Nov 04 22:17:31 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Acquiring lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:31 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Acquired lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:31 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Releasing lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:31 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Stop services. {{(pid=86293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 22:17:31 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Killing children. {{(pid=86293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 22:17:31 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Waiting on 1 children to exit Nov 04 22:17:35 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Acquiring lock "singleton_lock" {{(pid=86511) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:35 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Acquired lock "singleton_lock" {{(pid=86511) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:35 devstack cinder-volume[86511]: DEBUG oslo_concurrency.lockutils [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Releasing lock "singleton_lock" {{(pid=86511) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:35 devstack cinder-volume[86511]: WARNING amqp [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 22:17:35 devstack cinder-volume[86511]: WARNING amqp [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 22:17:35 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-5fb542f9-c963-415c-969f-cf61aef3316e None None] Child 86511 exited with status 0 Nov 04 22:17:35 devstack cinder-volume[86866]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 22:17:35 devstack cinder-volume[86866]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 22:17:35 devstack cinder-volume[86866]: we strongly recommend against using it for new projects. Nov 04 22:17:35 devstack cinder-volume[86866]: If you are already using Eventlet, we recommend migrating to a different Nov 04 22:17:35 devstack cinder-volume[86866]: framework. For more detail see Nov 04 22:17:35 devstack cinder-volume[86866]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 22:17:35 devstack cinder-volume[86866]: import eventlet # noqa Nov 04 22:17:38 devstack cinder-volume[86866]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 22:17:38 devstack cinder-volume[86866]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 22:17:38 devstack cinder-volume[86866]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 22:17:39 devstack cinder-volume[86866]: INFO dbcounter [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Registered counter for database cinder Nov 04 22:17:39 devstack cinder-volume[86866]: DEBUG oslo_db.sqlalchemy.engines [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG dbcounter [-] [86866] Writer thread running {{(pid=86866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:17:40 devstack cinder-volume[86866]: INFO cinder.rpc [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 22:17:40 devstack cinder-volume[86866]: INFO cinder.rpc [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_db.sqlalchemy.engines [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:40 devstack cinder-volume[86866]: INFO cinder.volume.manager [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Determined volume DB was empty at startup. Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG cinder.volume.manager [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86866) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 22:17:40 devstack cinder-volume[86866]: WARNING stevedore.named [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 22:17:40 devstack cinder-volume[86866]: WARNING castellan.key_manager [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:17:40 devstack cinder-volume[86866]: WARNING cinder.keymgr.conf_key_mgr [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 22:17:40 devstack cinder-volume[86866]: INFO cinder.volume.manager [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_db.sqlalchemy.engines [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:40 devstack cinder-volume[86866]: INFO oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Starting 1 workers Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Started child 87173 {{(pid=86866) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Full set of CONF: {{(pid=86866) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] ******************************************************************************** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] Configuration options gathered from: {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] ================================================================================ {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] allow_availability_zone_fallback = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[87173]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] allow_compression_on_image_upload = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] allowed_direct_url_schemes = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] api_rate_limit = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] auth_strategy = keystone {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_availability_zone = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_host = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_stats_polling_interval = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backup_api_class = cinder.backup.api.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backup_name_template = backup-%s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backup_use_same_host = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backup_use_temp_snapshot = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] chap_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] chap_username = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_internal_tenant_project_id = b132f16ff7c741539e0a6c09922fd525 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_internal_tenant_user_id = f8b226a4584e40aca878ed9376a92567 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cluster = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] compression_format = gzip {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] compute_api_class = cinder.compute.nova.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] config_dir = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] config_source = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] control_exchange = openstack {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] debug = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] default_availability_zone = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] default_group_type = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] default_volume_type = QuobyteHD {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] disk_geometry = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_client_cert = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_client_cert_key = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_data_namespace = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_ssl_cert_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_ssl_cert_verify = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] driver_use_ssl = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] enable_new_services = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] enable_unsupported_driver = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] enabled_backends = ['QuobyteHD'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] enforce_multipath_for_image_xfer = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] filter_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_api_insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_api_ssl_compression = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_ca_certificates_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_catalog_info = image:glance:publicURL {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_num_retries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance_request_timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] goodness_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] graceful_shutdown_timeout = 5 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] group_api_class = cinder.group.api.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] host = devstack {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_compress_on_upload = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_conversion_address_space_limit = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_conversion_cpu_limit = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_conversion_disable = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_introspection_address_space_limit = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_introspection_cpu_limit = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_upload_use_cinder_backend = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_upload_use_internal_tenant = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_volume_cache_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_volume_cache_max_count = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] image_volume_cache_max_size_gb = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] init_host_max_objects_retrieval = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] instance_format = [instance: %(uuid)s] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iscsi_target_flags = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iscsi_write_cache = on {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iser_helper = tgtadm {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iser_ip_address = 192.168.122.189 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iser_port = 3260 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_color = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_config_append = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_dir = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_options = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_rotate_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_rotate_interval_type = days {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] log_rotation_type = none {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] max_age = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] max_logfile_count = 30 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] max_logfile_size_mb = 200 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] max_over_subscription_ratio = 20.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] message_reap_interval = 86400 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] message_ttl = 2592000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] migration_create_volume_timeout_secs = 300 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] monkey_patch = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] monkey_patch_modules = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] my_ip = 192.168.122.189 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] no_snapshot_gb_quota = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] num_iser_scan_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] num_shell_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] num_volume_device_scan_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] nvmeof_conn_info_version = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] nvmet_ns_id = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] nvmet_port_id = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_max_limit = 1000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_ext_list = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_listen_port = 8776 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_use_ssl = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] osapi_volume_workers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] per_volume_size_limit = -1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] periodic_fuzzy_delay = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] periodic_interval = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] public_endpoint = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] publish_errors = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_backup_gigabytes = 1000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_backups = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_gigabytes = 1000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_groups = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_snapshots = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] quota_volumes = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] rate_limit_burst = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] rate_limit_except_level = CRITICAL {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] rate_limit_interval = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] reinit_driver_count = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] replication_device = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] report_discard_supported = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] report_interval = 120 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] reservation_clean_interval = 86400 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] reservation_expire = 86400 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] reserved_image_namespaces = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] reserved_percentage = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] rpc_response_timeout = 120 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] run_external_periodic_tasks = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] scst_target_driver = iscsi {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] scst_target_iqn_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_down_time = 720 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87173) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] shell_completion = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] snapshot_name_template = snapshot-%s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] split_loggers = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] state_path = /opt/stack/data/cinder {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] storage_availability_zone = nova {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] storage_protocol = iSCSI {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] syslog_log_facility = LOG_USER {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_helper = lioadm {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_ip_address = 192.168.122.189 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_port = 3260 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_protocol = iscsi {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] target_secondary_ip_addresses = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] trace_flags = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] transport_url = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] until_refresh = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_chap_auth = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_default_quota_class = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_journal = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_json = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_multipath_for_image_xfer = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_stderr = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] use_syslog = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] verify_glance_signatures = enabled {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_api_class = cinder.volume.api.API {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_backend_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_clear = zero {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_clear_ionice = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_clear_size = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_copy_bps_limit = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_dd_blocksize = 1M {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_name_template = volume-%s {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_service_inithost_offload = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volume_usage_audit_period = month {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] zoning_mode = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_concurrency.disable_process_locking = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.auth_section = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.auth_type = password {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.auth_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.cache = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.include_service_catalog = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.interface = public {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcache_username = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.region_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.service_type = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.backend = dogpile.cache.null {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.backend_argument = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.backend_expiration_time = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.config_prefix = cache.oslo {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.debug_cache_backend = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.enable_retry_client = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.enable_socket_keepalive = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.expiration_time = 600 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.hashclient_retry_attempts = 2 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_dead_retry = 300 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_pool_maxsize = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_sasl_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.proxies = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.redis_db = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.redis_server = localhost:6379 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.retry_attempts = 2 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.retry_delay = 0.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.socket_keepalive_count = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.socket_keepalive_idle = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.socket_keepalive_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.socket_timeout = 1.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.tls_allowed_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.tls_cafile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.tls_certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.tls_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.tls_keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cache.username = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] coordination.backend_url = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.asyncio_connection = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.asyncio_slave_connection = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.backend = sqlalchemy {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.connection = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.connection_debug = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.connection_parameters = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.connection_recycle_time = 3600 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.connection_trace = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.db_inc_retry_interval = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.db_max_retries = 20 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.db_max_retry_interval = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.db_retry_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.max_overflow = 50 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.max_pool_size = 5 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.max_retries = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.mysql_wsrep_sync_wait = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.pool_timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.retry_interval = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.slave_connection = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.sqlite_synchronous = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.synchronous_reader = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] database.use_db_reconnect = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_tracing.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.connection_string = messaging:// {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.es_doc_type = notification {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.es_scroll_size = 10000 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.es_scroll_time = 2m {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.filter_error_trace = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.hmac_keys = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.sentinel_service_name = mymaster {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.socket_timeout = 0.1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.trace_requests = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler.trace_sqlalchemy = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler_jaeger.process_tags = {} {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler_jaeger.service_name_prefix = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] profiler_otlp.service_name_prefix = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.enforce_new_defaults = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.policy_default_rule = default {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.policy_file = policy.yaml {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.group = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.helper_command = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] privsep_osbrick.user = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.group = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.helper_command = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] cinder_sys_admin.user = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.auth_section = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.auth_type = password {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.cafile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.collect_timing = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.send_service_user_token = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.split_loggers = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.tls_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] service_user.tls_min_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.auth_section = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.auth_type = password {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.collect_timing = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.region_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.split_loggers = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.tls_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] glance.tls_min_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.backend_availability_zone = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.chap_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.chap_username = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.disk_geometry = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_client_cert = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_client_cert_key = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_data_namespace = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.driver_use_ssl = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.extra_capabilities = {} {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.filter_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.goodness_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iscsi_target_flags = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iscsi_write_cache = on {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iser_helper = tgtadm {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iser_port = 3260 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_host = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_login = admin {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_mount_options = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_private_key = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_share_path = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.num_shell_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.quobyte_volume_url = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.replication_device = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.report_discard_supported = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.reserved_percentage = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_helper = tgtadm {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_port = 3260 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_protocol = iscsi {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.trace_flags = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.unique_fqdn_network = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.use_chap_auth = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_backend_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_clear = zero {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_clear_ionice = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_clear_size = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_reports.file_event_handler = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_reports.log_dir = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.backend_availability_zone = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.backend_host = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87173) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 22:17:40 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.chap_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.chap_username = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.chiscsi_conf = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.disk_geometry = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_client_cert = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_data_namespace = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.driver_use_ssl = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.extra_capabilities = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Running cmd (subprocess): mount.quobyte {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.filter_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.goodness_function = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iser_helper = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iser_ip_address = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iser_port = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.iser_target_prefix = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_host = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_login = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_mount_options = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_password = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_private_key = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_share_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_ssh_port = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.num_shell_tries = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.nvmet_port_id = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.replication_device = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.report_discard_supported = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.reserved_percentage = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.scst_target_driver = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.storage_protocol = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_helper = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_ip_address = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_port = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_prefix = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_protocol = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.trace_flags = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.use_chap_auth = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_clear = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_clear_size = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] QuobyteHD.volumes_dir = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_notifications.driver = [] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_notifications.retry = -1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] key_manager.fixed_key = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.barbican_api_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.barbican_endpoint = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.barbican_endpoint_type = public {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.barbican_region_name = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.cafile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.collect_timing = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.number_of_retries = 60 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.retry_delay = 1 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.send_service_user_token = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.split_loggers = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.tls_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.tls_min_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.verify_ssl = True {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican.verify_ssl_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.auth_section = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.auth_type = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.cafile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.certfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.collect_timing = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.insecure = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.keyfile = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.split_loggers = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.timeout = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.tls_ciphers = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] barbican_service_user.tls_min_version = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.approle_role_id = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.approle_secret_id = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.auth_method = approle {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.auth_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.kv_mountpoint = secret {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.kv_path = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.kv_version = 2 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.namespace = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.root_token_id = **** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.ssl_ca_crt_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.timeout = 60.0 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.token_file = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.token_role = None {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.use_ssl = False {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 22:17:40 devstack cinder-volume[86866]: DEBUG oslo_service.backend._eventlet.service [None req-535872b4-3417-40ee-a3c5-07e5f8291f44 None None] ******************************************************************************** {{(pid=86866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 22:17:40 devstack quobyte-client[87174]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 22:17:40 devstack quobyte-client[87174]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:40 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:40 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:40 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:40 devstack cinder-volume[87173]: INFO cinder.volume.driver [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.driver [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5663986206055, 'free_capacity_gb': 1773.5663986206055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87173) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_db.sqlalchemy.engines [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writer thread running {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.db.api [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Building query based on filter {{(pid=87173) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87173) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:40 devstack cinder-volume[87173]: INFO cinder.keymgr.migration [None req-f06bdd18-0ef9-43fb-8028-d6ce1a60c88f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 22:17:40 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:40 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:41 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:17:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Driver initialization completed successfully. Nov 04 22:17:41 devstack cinder-volume[87173]: INFO cinder.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Initiating service 3 cleanup Nov 04 22:17:41 devstack cinder-volume[87173]: INFO cinder.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Service 3 cleanup completed. Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG cinder.service [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Creating RPC server for service cinder-volume {{(pid=87173) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG cinder.service [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87173) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 22:17:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:17:41 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:17:41 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:17:41 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Nov 04 22:17:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:17:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d4e01737-4b14-487d-90ac-0fd598821819 None None] Driver post RPC initialization completed successfully. Nov 04 22:17:50 devstack cinder-volume[86866]: DEBUG dbcounter [-] [86866] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:17:51 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:17:51 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:17:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:17:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 6 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:17:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Flow 'volume_create_manager' (906023ff-3552-40e3-abaf-42289657e3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82258878-c603-41f3-a4b3-60f2409d687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82258878-c603-41f3-a4b3-60f2409d687b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1102433830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949225d5-316d-4c15-b4a1-5e60e5e92a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd1916b1265400d9ed462e5b3f2451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:18:48Z,use_quota=True,user_id='19d2a3cefda7429eaf994ad8671813c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b5305-1535-4dff-951d-24e74b32d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b5305-1535-4dff-951d-24e74b32d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdad0f3f-4ae9-4b05-a358-565d9b89d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdad0f3f-4ae9-4b05-a358-565d9b89d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949225d5-316d-4c15-b4a1-5e60e5e92a26', 'volume_name': 'volume-949225d5-316d-4c15-b4a1-5e60e5e92a26', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19786ca7-9577-43db-8c4a-35cae9cbabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19786ca7-9577-43db-8c4a-35cae9cbabc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5dbde-eae9-49a5-87d7-8356c157c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Volume 949225d5-316d-4c15-b4a1-5e60e5e92a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949225d5-316d-4c15-b4a1-5e60e5e92a26', 'volume_size': 1} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1102433830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949225d5-316d-4c15-b4a1-5e60e5e92a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd1916b1265400d9ed462e5b3f2451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:18:48Z,use_quota=True,user_id='19d2a3cefda7429eaf994ad8671813c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Creating volume 949225d5-316d-4c15-b4a1-5e60e5e92a26 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:18:48 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:18:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:18:48 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 1073741824 Nov 04 22:18:48 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:18:50 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 1073741824" returned: 0 in 1.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:18:50 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 Nov 04 22:18:50 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:18:50 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26" returned: 0 in 0.544s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5dbde-eae9-49a5-87d7-8356c157c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949225d5-316d-4c15-b4a1-5e60e5e92a26', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4e4f69-e271-4e8a-9f58-25e58f675c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:18:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Volume volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 (949225d5-316d-4c15-b4a1-5e60e5e92a26): created successfully Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4e4f69-e271-4e8a-9f58-25e58f675c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:18:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Flow 'volume_create_manager' (906023ff-3552-40e3-abaf-42289657e3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:18:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3884ff4f-7ec6-41f8-9362-d0bceec9d07b tempest-DeleteServersTestJSON-198103153 None] Created volume successfully. Nov 04 22:18:55 devstack cinder-volume[87173]: WARNING py.warnings [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 04 22:18:55 devstack cinder-volume[87173]: .first() Nov 04 22:18:55 devstack cinder-volume[87173]: Nov 04 22:18:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:18:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:18:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:18:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-949225d5-316d-4c15-b4a1-5e60e5e92a26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa9a75eb-41dc-4654-a522-5b5c65f4b168', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:18:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-36127e6d-8066-4578-9b55-6234b32a753d req-92c0d859-4e95-4376-a28e-bcc9f4fa7a7f tempest-DeleteServersTestJSON-198103153 None] attachment_update completed successfully. Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:18:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:18:56 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:18:56 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:18:57 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Nov 04 22:18:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.603s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:18:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:18:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:18:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 6 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:18:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:19:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-9f02ea92-3a8e-4f0c-95ef-089113da7327 req-93508e82-4583-4e77-808a-c96ef3a0228b tempest-DeleteServersTestJSON-198103153 None] Terminate volume connection completed successfully. Nov 04 22:19:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-9f02ea92-3a8e-4f0c-95ef-089113da7327 req-93508e82-4583-4e77-808a-c96ef3a0228b tempest-DeleteServersTestJSON-198103153 None] Deleting attachment aa9a75eb-41dc-4654-a522-5b5c65f4b168. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:19:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "cinder-949225d5-316d-4c15-b4a1-5e60e5e92a26-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:19:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "cinder-949225d5-316d-4c15-b4a1-5e60e5e92a26-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:19:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "cinder-quobyte-949225d5-316d-4c15-b4a1-5e60e5e92a26" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:19:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "cinder-quobyte-949225d5-316d-4c15-b4a1-5e60e5e92a26" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:19:04 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph0bmhiv5/privsep.sock'] Nov 04 22:19:04 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph0bmhiv5/privsep.sock Nov 04 22:19:04 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 22:19:05 devstack cinder-volume[87173]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 22:19:05 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:05 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Spawned new privsep daemon via rootwrap Nov 04 22:19:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Accepted privsep connection to /tmp/tmph0bmhiv5/privsep.sock {{(pid=87173) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 22:19:05 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 22:19:05 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 22:19:05 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 22:19:05 devstack cinder-volume[87173]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88792 Nov 04 22:19:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c480bfe-7011-4f10-bbf3-10d77aa3bce5]: (2,) {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:19:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b661e-3082-4954-b939-05faad8a74e5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:19:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:06 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 Nov 04 22:19:06 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:06 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26" returned: 0 in 0.460s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:06 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26 Nov 04 22:19:06 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:06 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-949225d5-316d-4c15-b4a1-5e60e5e92a26" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "cinder-quobyte-949225d5-316d-4c15-b4a1-5e60e5e92a26" released by "delete_volume" :: held 2.217s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:19:06 devstack cinder-volume[87173]: WARNING cinder.quota [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:19:06 devstack cinder-volume[87173]: WARNING cinder.quota [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Created reservations ['ebf042c7-74ec-40f9-ab6b-d3572954c2b5', '273e0539-70b8-4ac3-8e2d-eeebf3c9e1ee', '77c08da8-f1b1-45e1-8a3f-abfb18b9ba05', '9e9d99c8-0c18-4a0f-8e1c-2850105d2373'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:06 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:19:06 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:07 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:07 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:19:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Deleted volume successfully. Nov 04 22:19:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-03375f60-a0bc-4260-b54d-eff52ce3b9c3 tempest-DeleteServersTestJSON-198103153 None] Lock "cinder-949225d5-316d-4c15-b4a1-5e60e5e92a26-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:19:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Flow 'volume_create_manager' (709ee228-b609-4518-8438-8259342e6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cdd2c-e72e-4201-b711-b1f321e82cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cdd2c-e72e-4201-b711-b1f321e82cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-645164425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1a797-740e-4c23-b874-8bd831872407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702efa01c91c49dd978eba171e4e6c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:15Z,use_quota=True,user_id='934bcb7e1fdd47aba744eb8791df9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f06b4-560c-494c-ae28-c64f04434ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f06b4-560c-494c-ae28-c64f04434ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e72c46-4d58-42cc-918d-ea0a4d83b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e72c46-4d58-42cc-918d-ea0a4d83b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c1a797-740e-4c23-b874-8bd831872407', 'volume_name': 'volume-13c1a797-740e-4c23-b874-8bd831872407', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5735ce-4d40-4a4f-8356-27bb2f279c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5735ce-4d40-4a4f-8356-27bb2f279c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f9fdfb-5cbd-4d34-824f-ef8c4e8f37d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Volume 13c1a797-740e-4c23-b874-8bd831872407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c1a797-740e-4c23-b874-8bd831872407', 'volume_size': 1} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-645164425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1a797-740e-4c23-b874-8bd831872407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702efa01c91c49dd978eba171e4e6c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:15Z,use_quota=True,user_id='934bcb7e1fdd47aba744eb8791df9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Creating volume 13c1a797-740e-4c23-b874-8bd831872407 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:19:15 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:15 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 1073741824 Nov 04 22:19:15 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:15 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 1073741824" returned: 0 in 0.783s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:16 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 Nov 04 22:19:16 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:16 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f9fdfb-5cbd-4d34-824f-ef8c4e8f37d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c1a797-740e-4c23-b874-8bd831872407', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db46e7-6669-4d78-8266-3edfef55b53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Volume volume-13c1a797-740e-4c23-b874-8bd831872407 (13c1a797-740e-4c23-b874-8bd831872407): created successfully Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db46e7-6669-4d78-8266-3edfef55b53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Flow 'volume_create_manager' (709ee228-b609-4518-8438-8259342e6003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-52f388d4-a6e4-4a88-9a84-03c2c000fdc7 tempest-VolumesAdminNegativeTest-60308190 None] Created volume successfully. Nov 04 22:19:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Acquiring lock "cinder-13c1a797-740e-4c23-b874-8bd831872407-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:19:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "cinder-13c1a797-740e-4c23-b874-8bd831872407-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:19:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Acquiring lock "cinder-quobyte-13c1a797-740e-4c23-b874-8bd831872407" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:19:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "cinder-quobyte-13c1a797-740e-4c23-b874-8bd831872407" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:19:18 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec5e6f-f3a1-4ac8-84af-90155fb511c6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:19:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:18 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 Nov 04 22:19:18 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:18 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407" returned: 0 in 0.713s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:18 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407 Nov 04 22:19:18 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:19 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-13c1a797-740e-4c23-b874-8bd831872407" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "cinder-quobyte-13c1a797-740e-4c23-b874-8bd831872407" released by "delete_volume" :: held 1.223s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Created reservations ['8b9d998b-bfb6-4b08-9ca9-95cbc3642516', '4302d6f9-79c9-4616-b0b4-dcb295fa2972', 'f59a5ae6-dc9d-4767-81f6-8d42a008729a', '94545d95-5d39-420e-8ff0-2ecae1247fea'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:19 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:19:19 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (677c87f7-d2f1-482e-a9fe-2af899e0c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6896c20f-409b-4494-b5d2-b9fb723a018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6896c20f-409b-4494-b5d2-b9fb723a018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-389437331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8ea633-cc74-4b18-8707-a35af7604bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:20Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f926fecd-aa51-4c9f-ab07-5a6622e18a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f926fecd-aa51-4c9f-ab07-5a6622e18a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d73fc6-99b6-46cd-9f4e-7d90e6edc5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d73fc6-99b6-46cd-9f4e-7d90e6edc5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8ea633-cc74-4b18-8707-a35af7604bb7', 'volume_name': 'volume-da8ea633-cc74-4b18-8707-a35af7604bb7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c090806d-c5a3-490f-b1f8-88a17cbd3458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c090806d-c5a3-490f-b1f8-88a17cbd3458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b4340b-af65-42bb-ada9-f277d07501df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:19 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Volume da8ea633-cc74-4b18-8707-a35af7604bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8ea633-cc74-4b18-8707-a35af7604bb7', 'volume_size': 1} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-389437331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8ea633-cc74-4b18-8707-a35af7604bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:20Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Creating volume da8ea633-cc74-4b18-8707-a35af7604bb7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:19:19 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:19:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:19 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 1073741824 Nov 04 22:19:19 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:20 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.531s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:20 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:19:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Deleted volume successfully. Nov 04 22:19:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed7f8008-b7e6-45ed-995b-542fdb5de156 tempest-VolumesAdminNegativeTest-60308190 None] Lock "cinder-13c1a797-740e-4c23-b874-8bd831872407-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:19:20 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 1073741824" returned: 0 in 0.948s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:20 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 Nov 04 22:19:20 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:21 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7" returned: 0 in 0.399s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b4340b-af65-42bb-ada9-f277d07501df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8ea633-cc74-4b18-8707-a35af7604bb7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd77fb-1bb4-4517-b3f5-bbe73a6e4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Volume volume-da8ea633-cc74-4b18-8707-a35af7604bb7 (da8ea633-cc74-4b18-8707-a35af7604bb7): created successfully Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd77fb-1bb4-4517-b3f5-bbe73a6e4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (677c87f7-d2f1-482e-a9fe-2af899e0c96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-cc9a0714-67ec-4f5f-8b3c-a21e84e2ae05 tempest-AttachVolumeNegativeTest-1569897183 None] Created volume successfully. Nov 04 22:19:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c6ce3652-85ae-492c-a1c7-51ab41ea33ad req-30b97185-9a03-461a-9952-ec6d9e91ddf5 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c6ce3652-85ae-492c-a1c7-51ab41ea33ad req-30b97185-9a03-461a-9952-ec6d9e91ddf5 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c6ce3652-85ae-492c-a1c7-51ab41ea33ad req-30b97185-9a03-461a-9952-ec6d9e91ddf5 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-c6ce3652-85ae-492c-a1c7-51ab41ea33ad req-30b97185-9a03-461a-9952-ec6d9e91ddf5 tempest-AttachVolumeNegativeTest-1569897183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-da8ea633-cc74-4b18-8707-a35af7604bb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09b0b022-c818-4e05-90b6-eea86af94fc3', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:19:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-c6ce3652-85ae-492c-a1c7-51ab41ea33ad req-30b97185-9a03-461a-9952-ec6d9e91ddf5 tempest-AttachVolumeNegativeTest-1569897183 None] attachment_update completed successfully. Nov 04 22:19:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=28,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:19:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=30,cinder:SELECT=32,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Flow 'volume_create_manager' (768e7063-3189-4e62-826b-9e2d5c26b660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1350df-e3ec-4099-a235-dd7fa987cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1350df-e3ec-4099-a235-dd7fa987cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1094468644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13fdd07-838e-4340-8452-f44ce4475fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d929c736a4cf4820636dda378b2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:45Z,use_quota=True,user_id='306375abdaf8489d99acf023b36b9317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f865c16-5424-4ad9-b5eb-d8c43fd4233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f865c16-5424-4ad9-b5eb-d8c43fd4233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88c1be-24a7-4d35-96ed-cffc57697e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88c1be-24a7-4d35-96ed-cffc57697e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13fdd07-838e-4340-8452-f44ce4475fe0', 'volume_name': 'volume-b13fdd07-838e-4340-8452-f44ce4475fe0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120ec1ad-94ad-41e2-a416-fc2b436b463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120ec1ad-94ad-41e2-a416-fc2b436b463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada9d35f-169d-4c5a-a33a-84c2e502e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Volume b13fdd07-838e-4340-8452-f44ce4475fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13fdd07-838e-4340-8452-f44ce4475fe0', 'volume_size': 1} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1094468644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13fdd07-838e-4340-8452-f44ce4475fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d929c736a4cf4820636dda378b2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:19:45Z,use_quota=True,user_id='306375abdaf8489d99acf023b36b9317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Creating volume b13fdd07-838e-4340-8452-f44ce4475fe0 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:19:45 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:19:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:45 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 1073741824 Nov 04 22:19:45 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:46 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 1073741824" returned: 0 in 0.529s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:46 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 Nov 04 22:19:46 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:46 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada9d35f-169d-4c5a-a33a-84c2e502e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13fdd07-838e-4340-8452-f44ce4475fe0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba7b6a0-ff59-4c57-ad61-f605134310ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:19:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Volume volume-b13fdd07-838e-4340-8452-f44ce4475fe0 (b13fdd07-838e-4340-8452-f44ce4475fe0): created successfully Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba7b6a0-ff59-4c57-ad61-f605134310ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:19:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Flow 'volume_create_manager' (768e7063-3189-4e62-826b-9e2d5c26b660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:19:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f3298eed-6fbb-4bf7-beef-b9dc3741021d tempest-TaggedAttachmentsTest-872373254 None] Created volume successfully. Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:19:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:19:56 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:19:56 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:19:57 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Nov 04 22:19:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.558s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:19:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:19:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:19:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 8 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:19:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:20:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-5bd19edd-02e5-4f17-86e8-afec58d68910 req-252d9642-75b6-4986-ac4c-633543b12df4 tempest-AttachVolumeNegativeTest-1569897183 None] Terminate volume connection completed successfully. Nov 04 22:20:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-5bd19edd-02e5-4f17-86e8-afec58d68910 req-252d9642-75b6-4986-ac4c-633543b12df4 tempest-AttachVolumeNegativeTest-1569897183 None] Deleting attachment 09b0b022-c818-4e05-90b6-eea86af94fc3. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (f6042796-de02-40fa-b98b-57a750fa1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebac90d-dcdc-405a-9c8f-3443c928e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebac90d-dcdc-405a-9c8f-3443c928e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725760942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:20:25Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4991e344-a84f-44a6-8d75-cb2dc55375c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4991e344-a84f-44a6-8d75-cb2dc55375c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5beee7-8c24-4084-99e4-211793a7afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5beee7-8c24-4084-99e4-211793a7afb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3', 'volume_name': 'volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7bb4a-e689-4539-a07d-4526e1f78699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7bb4a-e689-4539-a07d-4526e1f78699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22871b30-3a01-4cd6-9e90-9d4dfaee8b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:25 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Volume cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3', 'volume_size': 1} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725760942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:20:25Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Creating volume cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:20:25 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:20:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:20:25 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 1073741824 Nov 04 22:20:25 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:20:26 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 1073741824" returned: 0 in 0.776s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:20:26 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 Nov 04 22:20:26 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:20:26 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" returned: 0 in 0.659s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22871b30-3a01-4cd6-9e90-9d4dfaee8b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ce9c27-4309-4a97-8797-bd86c764c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:26 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Volume volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 (cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3): created successfully Nov 04 22:20:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ce9c27-4309-4a97-8797-bd86c764c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (f6042796-de02-40fa-b98b-57a750fa1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:20:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c0572cb2-8df4-4b21-b0c9-b813f8668d87 tempest-AttachVolumeTestJSON-957547757 None] Created volume successfully. Nov 04 22:20:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-8ed8330f-59a2-4ca9-97ef-93772cda79b4 req-b0f32e1c-46b0-4702-98fe-2d1573f23437 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-8ed8330f-59a2-4ca9-97ef-93772cda79b4 req-b0f32e1c-46b0-4702-98fe-2d1573f23437 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-8ed8330f-59a2-4ca9-97ef-93772cda79b4 req-b0f32e1c-46b0-4702-98fe-2d1573f23437 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-8ed8330f-59a2-4ca9-97ef-93772cda79b4 req-b0f32e1c-46b0-4702-98fe-2d1573f23437 tempest-AttachVolumeTestJSON-957547757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4c521fb-e9d4-40bb-8636-909be43da0f0', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:20:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-8ed8330f-59a2-4ca9-97ef-93772cda79b4 req-b0f32e1c-46b0-4702-98fe-2d1573f23437 tempest-AttachVolumeTestJSON-957547757 None] attachment_update completed successfully. Nov 04 22:20:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:20:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Flow 'volume_create_manager' (ed590518-c876-4a78-8066-be3ba2d21ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c112f5-d694-4b7a-9652-b705b91b8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c112f5-d694-4b7a-9652-b705b91b8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-967091196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc63d18-4d8e-4b62-b8d2-a1f08771dba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575dc75ea4cc4e0bb304671f8fb5147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:20:43Z,use_quota=True,user_id='63eaad779be2449dbbcdc6cf01eecbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f45bb9e-379b-45d2-8811-8e10e8248b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f45bb9e-379b-45d2-8811-8e10e8248b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a3b789-1e28-4cea-8f58-bfcbefe4d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a3b789-1e28-4cea-8f58-bfcbefe4d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc63d18-4d8e-4b62-b8d2-a1f08771dba7', 'volume_name': 'volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0010124-a2b8-49e2-b51b-d75973de84f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0010124-a2b8-49e2-b51b-d75973de84f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07491faa-de20-4fe6-b913-fad72b69374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:43 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Volume 6bc63d18-4d8e-4b62-b8d2-a1f08771dba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7', 'volume_size': 1} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-967091196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc63d18-4d8e-4b62-b8d2-a1f08771dba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575dc75ea4cc4e0bb304671f8fb5147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:20:43Z,use_quota=True,user_id='63eaad779be2449dbbcdc6cf01eecbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Creating volume 6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:20:43 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:20:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:20:43 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 1073741824 Nov 04 22:20:43 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:20:44 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Nov 04 22:20:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 1073741824" returned: 0 in 1.461s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:20:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:20:45 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 Nov 04 22:20:45 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:20:45 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" returned: 0 in 0.822s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07491faa-de20-4fe6-b913-fad72b69374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d561d5-c2ce-457b-a471-e8ac22bac345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:20:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Volume volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 (6bc63d18-4d8e-4b62-b8d2-a1f08771dba7): created successfully Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d561d5-c2ce-457b-a471-e8ac22bac345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:20:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Flow 'volume_create_manager' (ed590518-c876-4a78-8066-be3ba2d21ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:20:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-59004c0c-01ad-4582-a7e3-9a3f33f8bc20 tempest-ServerRescueNegativeTestJSON-291931721 None] Created volume successfully. Nov 04 22:20:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-b8233472-fa4c-45e2-b87a-963c3ee685df req-704b6dfc-736e-494e-81ca-7c915b7c1baf tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-b8233472-fa4c-45e2-b87a-963c3ee685df req-704b6dfc-736e-494e-81ca-7c915b7c1baf tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-b8233472-fa4c-45e2-b87a-963c3ee685df req-704b6dfc-736e-494e-81ca-7c915b7c1baf tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-b8233472-fa4c-45e2-b87a-963c3ee685df req-704b6dfc-736e-494e-81ca-7c915b7c1baf tempest-TaggedAttachmentsTest-872373254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-b13fdd07-838e-4340-8452-f44ce4475fe0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86121365-e17c-4a67-9530-a004d82694ac', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:20:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-b8233472-fa4c-45e2-b87a-963c3ee685df req-704b6dfc-736e-494e-81ca-7c915b7c1baf tempest-TaggedAttachmentsTest-872373254 None] attachment_update completed successfully. Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:20:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:20:56 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:20:56 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:20:57 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.423s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 8 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:20:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-3acacf4b-94af-40fe-b548-0dc2608ea26a req-6bfe9474-2c26-42e3-aefe-7d7fcaaa7775 tempest-TaggedAttachmentsTest-872373254 None] Terminate volume connection completed successfully. Nov 04 22:20:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-3acacf4b-94af-40fe-b548-0dc2608ea26a req-6bfe9474-2c26-42e3-aefe-7d7fcaaa7775 tempest-TaggedAttachmentsTest-872373254 None] Deleting attachment 86121365-e17c-4a67-9530-a004d82694ac. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:21:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Acquiring lock "cinder-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "cinder-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Acquiring lock "cinder-quobyte-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "cinder-quobyte-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e4622-d36a-4852-ab44-9e3f00980274]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:03 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 Nov 04 22:21:03 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:04 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" returned: 0 in 0.888s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:04 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7 Nov 04 22:21:04 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:04 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" returned: 0 in 0.529s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "cinder-quobyte-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7" released by "delete_volume" :: held 1.510s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Created reservations ['3edb71f1-28a0-4acd-af4e-ffb6293ea040', '06e2567a-1d41-452c-aa07-840170dfff81', '81e5a6f0-ba7f-473e-87a2-4c65cebf5607', '1fd42d17-c017-4d3c-b753-a3f1c2fa553c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:04 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:21:04 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:05 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.327s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:05 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:21:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Deleted volume successfully. Nov 04 22:21:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ca6e8507-6710-4dec-b08a-538605b0a465 tempest-ServerRescueNegativeTestJSON-291931721 None] Lock "cinder-6bc63d18-4d8e-4b62-b8d2-a1f08771dba7-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "cinder-b13fdd07-838e-4340-8452-f44ce4475fe0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "cinder-b13fdd07-838e-4340-8452-f44ce4475fe0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "cinder-quobyte-b13fdd07-838e-4340-8452-f44ce4475fe0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "cinder-quobyte-b13fdd07-838e-4340-8452-f44ce4475fe0" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[770aedc8-d5aa-428b-855e-9c30068b0668]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:12 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 Nov 04 22:21:12 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:13 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0" returned: 0 in 0.528s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:13 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0 Nov 04 22:21:13 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:13 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b13fdd07-838e-4340-8452-f44ce4475fe0" returned: 0 in 0.316s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "cinder-quobyte-b13fdd07-838e-4340-8452-f44ce4475fe0" released by "delete_volume" :: held 0.913s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Created reservations ['a94381d5-64f9-4364-adcf-0b12da568dba', '131a092a-ce31-4ecf-ae80-352e50677737', '64a7b803-5ef3-4b81-a59e-422ecf3122c7', '5214727f-5ac7-4b27-9a54-d3b1a4de4d5c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:13 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:21:13 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:13 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:21:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Deleted volume successfully. Nov 04 22:21:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7b916d24-a703-4e7e-8c80-bdce3ea009bf tempest-TaggedAttachmentsTest-872373254 None] Lock "cinder-b13fdd07-838e-4340-8452-f44ce4475fe0-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:20 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:21:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (937e6541-ffe2-492f-ab7b-b2f253d6bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:21:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e59f7b-d463-48a6-aa9d-d31b5639faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e59f7b-d463-48a6-aa9d-d31b5639faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1731002434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a427c268-166d-477b-9c32-ede08e1e606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:21:21Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a9c24f-09a3-4ab5-a2f7-29c0db72f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a9c24f-09a3-4ab5-a2f7-29c0db72f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb004fd-d8b3-48b4-b65d-80956edc573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb004fd-d8b3-48b4-b65d-80956edc573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a427c268-166d-477b-9c32-ede08e1e606a', 'volume_name': 'volume-a427c268-166d-477b-9c32-ede08e1e606a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e53cfe4-f752-499a-9604-22b1fbb511fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e53cfe4-f752-499a-9604-22b1fbb511fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad72c449-6a28-490b-810e-c635e06a7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Volume a427c268-166d-477b-9c32-ede08e1e606a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a427c268-166d-477b-9c32-ede08e1e606a', 'volume_size': 1} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1731002434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a427c268-166d-477b-9c32-ede08e1e606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:21:21Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Creating volume a427c268-166d-477b-9c32-ede08e1e606a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:21:21 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:21 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a 1073741824 Nov 04 22:21:21 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:21 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a 1073741824" returned: 0 in 0.493s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:21 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a Nov 04 22:21:21 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:21 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad72c449-6a28-490b-810e-c635e06a7b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a427c268-166d-477b-9c32-ede08e1e606a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efbab62-7bc3-4243-a64b-aae014b30ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Volume volume-a427c268-166d-477b-9c32-ede08e1e606a (a427c268-166d-477b-9c32-ede08e1e606a): created successfully Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efbab62-7bc3-4243-a64b-aae014b30ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (937e6541-ffe2-492f-ab7b-b2f253d6bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:21:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-071891d0-9297-47d9-bb91-96c314e82fcf tempest-AttachVolumeNegativeTest-1569897183 None] Created volume successfully. Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Flow 'volume_create_manager' (c2713c93-b0ce-4262-8062-5dba60771fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec273e99-3041-4e86-919e-2a5c279fb11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec273e99-3041-4e86-919e-2a5c279fb11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629457888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a39ea-baba-431a-98d4-612974843678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbe7416f38f43bdaca41d399f318b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:21:22Z,use_quota=True,user_id='d07a28b4eff7484d942e9d3a2f718098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aae1994-162b-4f6a-a1a8-e70016e7f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aae1994-162b-4f6a-a1a8-e70016e7f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e987f1-6aba-4796-a541-fb465a4db988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e987f1-6aba-4796-a541-fb465a4db988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5a39ea-baba-431a-98d4-612974843678', 'volume_name': 'volume-af5a39ea-baba-431a-98d4-612974843678', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96659ec5-403a-4497-8e36-7951dd9a0820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96659ec5-403a-4497-8e36-7951dd9a0820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56dd68e-f25e-47f8-b12e-1e0b90e906b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Volume af5a39ea-baba-431a-98d4-612974843678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5a39ea-baba-431a-98d4-612974843678', 'volume_size': 1} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629457888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a39ea-baba-431a-98d4-612974843678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbe7416f38f43bdaca41d399f318b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:21:22Z,use_quota=True,user_id='d07a28b4eff7484d942e9d3a2f718098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Creating volume af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:21:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:21:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:22 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 1073741824 Nov 04 22:21:22 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:23 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-7c754483-7f20-439d-8457-6ccdc7e3b60a req-3f0f3809-fa28-4baa-8345-e9106d001c87 tempest-AttachVolumeTestJSON-957547757 None] Terminate volume connection completed successfully. Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-7c754483-7f20-439d-8457-6ccdc7e3b60a req-3f0f3809-fa28-4baa-8345-e9106d001c87 tempest-AttachVolumeTestJSON-957547757 None] Deleting attachment e4c521fb-e9d4-40bb-8636-909be43da0f0. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 1073741824" returned: 0 in 0.656s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:23 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 Nov 04 22:21:23 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:23 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56dd68e-f25e-47f8-b12e-1e0b90e906b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5a39ea-baba-431a-98d4-612974843678', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7971ac7c-7044-404f-a7ea-b85b79e3ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:21:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Volume volume-af5a39ea-baba-431a-98d4-612974843678 (af5a39ea-baba-431a-98d4-612974843678): created successfully Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7971ac7c-7044-404f-a7ea-b85b79e3ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:21:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Flow 'volume_create_manager' (c2713c93-b0ce-4262-8062-5dba60771fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:21:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-4c6f5af7-3a74-4379-8551-db0bf765bc6b req-d003202a-9f14-49b1-bdd5-899ea0449aeb tempest-VolumesSnapshotsTestJSON-962533544 None] Created volume successfully. Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-68cece29-48c3-47fb-b679-2342aff19136 req-d4ef4c27-8d2f-4f25-bf4c-7e38e8c435c3 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-68cece29-48c3-47fb-b679-2342aff19136 req-d4ef4c27-8d2f-4f25-bf4c-7e38e8c435c3 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-68cece29-48c3-47fb-b679-2342aff19136 req-d4ef4c27-8d2f-4f25-bf4c-7e38e8c435c3 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-68cece29-48c3-47fb-b679-2342aff19136 req-d4ef4c27-8d2f-4f25-bf4c-7e38e8c435c3 tempest-AttachVolumeNegativeTest-1569897183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-a427c268-166d-477b-9c32-ede08e1e606a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b849a20-092f-4b98-808e-54f46534f2bb', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:21:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-68cece29-48c3-47fb-b679-2342aff19136 req-d4ef4c27-8d2f-4f25-bf4c-7e38e8c435c3 tempest-AttachVolumeNegativeTest-1569897183 None] attachment_update completed successfully. Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Creating offline snapshot a547bc43-2dfd-4772-a1af-5cb8e1829652 of volume af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:21:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84fbd11-ca71-4e47-b4f3-a8b1458eef5a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:25 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 Nov 04 22:21:25 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:25 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678" returned: 0 in 0.553s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:25 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 1G Nov 04 22:21:25 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:26 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 1G" returned: 0 in 0.637s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a39ea-baba-431a-98d4-612974843678 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:26 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a39ea-baba-431a-98d4-612974843678 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 Nov 04 22:21:26 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:26 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a39ea-baba-431a-98d4-612974843678 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652" returned: 0 in 0.343s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:26 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 is being set with open permissions: ugo+rw Nov 04 22:21:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:26 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 Nov 04 22:21:26 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:26 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:27 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info Nov 04 22:21:27 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:27 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info" returned: 0 in 0.405s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:27 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info is being set with open permissions: ugo+rw Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:27 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info Nov 04 22:21:27 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-e4db1c02-b5f2-4bac-96cc-3da697410a33 req-a80a10de-5e9f-492a-8215-0e37681a36ad tempest-AttachVolumeNegativeTest-1569897183 None] Terminate volume connection completed successfully. Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-e4db1c02-b5f2-4bac-96cc-3da697410a33 req-a80a10de-5e9f-492a-8215-0e37681a36ad tempest-AttachVolumeNegativeTest-1569897183 None] Deleting attachment 3b849a20-092f-4b98-808e-54f46534f2bb. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:21:27 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.info" returned: 0 in 0.403s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-059ac6c0-01b4-4f6c-8145-8ae604261d81 req-01927350-365d-415a-a088-d1757d85e3e6 tempest-VolumesSnapshotsTestJSON-962533544 None] Create snapshot completed successfully Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "cinder-a547bc43-2dfd-4772-a1af-5cb8e1829652-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-a547bc43-2dfd-4772-a1af-5cb8e1829652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "cinder-quobyte-a547bc43-2dfd-4772-a1af-5cb8e1829652" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-a547bc43-2dfd-4772-a1af-5cb8e1829652" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Deleting offline snapshot a547bc43-2dfd-4772-a1af-5cb8e1829652 of volume af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] snapshot_file for this snap is: volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f221b694-84c9-46b1-8e13-bf2ccbe2b30f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:31 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 Nov 04 22:21:31 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:31 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652" returned: 0 in 0.647s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af5a39ea-baba-431a-98d4-612974843678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:21:31 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f26b68-de92-4be3-9fd4-9e1965d4f904]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:31 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 Nov 04 22:21:31 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:32 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678" returned: 0 in 0.573s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:32 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 Nov 04 22:21:32 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:32 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652" returned: 0 in 0.738s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:33 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652 Nov 04 22:21:33 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:33 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678.a547bc43-2dfd-4772-a1af-5cb8e1829652" returned: 0 in 0.442s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-a547bc43-2dfd-4772-a1af-5cb8e1829652" released by "_delete_snapshot" :: held 2.643s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" released by "delete_snapshot" :: held 2.718s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:33 devstack cinder-volume[87173]: WARNING cinder.quota [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.quota [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Created reservations ['c57d7812-ab94-4590-911f-5760538adf54', '45025270-0bce-493b-b022-7cb6351e9bcb', '00d2a5a5-7b05-41e6-a3d8-50efd23028d4', 'c038f1ee-0904-4cb6-8c14-e36289ca233c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:21:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Delete snapshot completed successfully. Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-5397504b-976f-4e8d-8f4e-06ad761270d9 req-15ea37d3-a4e6-4056-a3cf-4d1ade27ef79 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-a547bc43-2dfd-4772-a1af-5cb8e1829652-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "cinder-af5a39ea-baba-431a-98d4-612974843678-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-af5a39ea-baba-431a-98d4-612974843678-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:21:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" acquired by "delete_volume" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8683d4d9-f96b-4792-956f-44b1a0cc7183]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:34 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 Nov 04 22:21:34 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:34 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678" returned: 0 in 0.439s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:34 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678 Nov 04 22:21:34 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:34 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-af5a39ea-baba-431a-98d4-612974843678" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-quobyte-af5a39ea-baba-431a-98d4-612974843678" released by "delete_volume" :: held 0.974s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG cinder.quota [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Created reservations ['281f25ec-b857-4d20-87d7-ca3dfe6a1f6a', '0a9b73a1-6eb5-43ca-bd2e-e52d1c5df55b', '1a9cb0f2-bd17-4b79-b6b2-3181f76ffee0', 'dc42ec3f-9be6-4e6f-89b4-c5aa1706501e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:35 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:21:35 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:35 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG cinder.manager [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:21:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Deleted volume successfully. Nov 04 22:21:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-0b6b672e-e91b-4df2-b9a0-fcac5dfedf8f req-cd8ea392-7d99-471e-96d5-59005b198e70 tempest-VolumesSnapshotsTestJSON-962533544 None] Lock "cinder-af5a39ea-baba-431a-98d4-612974843678-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:21:41 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=46,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:21:41 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=47,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:21:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-64040852-0382-4cdf-915e-968ef428c5da tempest-GroupsV320Test-431459688 None] Group tempest-GroupsV320Test-Group-2099598348: creating Nov 04 22:21:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-64040852-0382-4cdf-915e-968ef428c5da tempest-GroupsV320Test-431459688 None] Group tempest-GroupsV320Test-Group-2099598348: created successfully Nov 04 22:21:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-64040852-0382-4cdf-915e-968ef428c5da tempest-GroupsV320Test-431459688 None] Create group completed successfully. Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Created reservations ['02e981d8-9f08-4ea2-9f9f-b5b954ca96d3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:53 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:21:53 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:54 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.488s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:54 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:21:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-393f5e0c-b225-4fa7-9fbf-c04abc065d5c tempest-GroupsV320Test-431459688 None] Delete group completed successfully. Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:21:56 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:21:56 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:21:56 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:21:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:03 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:22:03 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=8,cinder:INSERT=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (d3ab49c5-63a8-4f4e-859d-13dbdb23e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e9120b-1a00-41f5-9969-03b82bc78a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e9120b-1a00-41f5-9969-03b82bc78a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1021751039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f2838-b19a-4741-8d15-20f16c0847ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:16Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f2e0e-cb9b-4cbd-b983-e508a41a4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f2e0e-cb9b-4cbd-b983-e508a41a4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1673d8a0-e912-4078-9e92-3cf76a1ce34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1673d8a0-e912-4078-9e92-3cf76a1ce34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3f2838-b19a-4741-8d15-20f16c0847ea', 'volume_name': 'volume-1a3f2838-b19a-4741-8d15-20f16c0847ea', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7309c-8972-4869-98c7-ffd7d5cf0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7309c-8972-4869-98c7-ffd7d5cf0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b423a21f-9373-49be-a9db-99295aecbf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Volume 1a3f2838-b19a-4741-8d15-20f16c0847ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3f2838-b19a-4741-8d15-20f16c0847ea', 'volume_size': 1} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1021751039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f2838-b19a-4741-8d15-20f16c0847ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554e1cda62ae47158085e5e7e5dec250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:16Z,use_quota=True,user_id='3ed39387a7d84c9aa6633323018e733f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Creating volume 1a3f2838-b19a-4741-8d15-20f16c0847ea {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:15 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:15 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea 1073741824 Nov 04 22:22:15 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Flow 'volume_create_manager' (7f762d21-44d8-410f-aaaa-7ccee4056b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2132bdd6-c483-41ce-8f22-fda13bffde64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2132bdd6-c483-41ce-8f22-fda13bffde64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1306252506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f54ab0-7146-472d-9724-8a07b72ff38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6300b082d3340fcbf7faa0cfe49678f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:16Z,use_quota=True,user_id='cdd211cb991b4d9fb97829b3f8bcbb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9013f2a0-b880-4ef5-9254-8d231eea0dca),volume_type_id=9013f2a0-b880-4ef5-9254-8d231eea0dca)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f7fd29-0228-4b58-84fd-d13e6d2c988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f7fd29-0228-4b58-84fd-d13e6d2c988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a277e24-c58a-4d31-9ac3-7c294b060dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a277e24-c58a-4d31-9ac3-7c294b060dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f54ab0-7146-472d-9724-8a07b72ff38f', 'volume_name': 'volume-f0f54ab0-7146-472d-9724-8a07b72ff38f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004151a9-2c6f-4220-a958-e45e5093bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004151a9-2c6f-4220-a958-e45e5093bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74aa750b-a4af-4441-a6ae-1bbcd9414103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Volume f0f54ab0-7146-472d-9724-8a07b72ff38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f54ab0-7146-472d-9724-8a07b72ff38f', 'volume_size': 1} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:16 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea 1073741824" returned: 0 in 0.453s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:16 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea Nov 04 22:22:16 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:16 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1306252506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f54ab0-7146-472d-9724-8a07b72ff38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6300b082d3340fcbf7faa0cfe49678f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:16Z,use_quota=True,user_id='cdd211cb991b4d9fb97829b3f8bcbb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9013f2a0-b880-4ef5-9254-8d231eea0dca),volume_type_id=9013f2a0-b880-4ef5-9254-8d231eea0dca)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Creating volume f0f54ab0-7146-472d-9724-8a07b72ff38f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:16 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:16 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f 1073741824 Nov 04 22:22:16 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b423a21f-9373-49be-a9db-99295aecbf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3f2838-b19a-4741-8d15-20f16c0847ea', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97ef834-ad7c-4d96-be6d-4f248b32b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Volume volume-1a3f2838-b19a-4741-8d15-20f16c0847ea (1a3f2838-b19a-4741-8d15-20f16c0847ea): created successfully Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97ef834-ad7c-4d96-be6d-4f248b32b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Flow 'volume_create_manager' (d3ab49c5-63a8-4f4e-859d-13dbdb23e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a2845c4b-60e6-4bac-806d-02eeccc3f31b tempest-AttachVolumeNegativeTest-1569897183 None] Created volume successfully. Nov 04 22:22:17 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f 1073741824" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:17 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f Nov 04 22:22:17 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:17 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f" returned: 0 in 0.242s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74aa750b-a4af-4441-a6ae-1bbcd9414103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f54ab0-7146-472d-9724-8a07b72ff38f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def18a40-b446-4e7f-b4ed-2f099dc870ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:17 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Volume volume-f0f54ab0-7146-472d-9724-8a07b72ff38f (f0f54ab0-7146-472d-9724-8a07b72ff38f): created successfully Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def18a40-b446-4e7f-b4ed-2f099dc870ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Flow 'volume_create_manager' (7f762d21-44d8-410f-aaaa-7ccee4056b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-50e2dbc5-0a63-43c0-adb3-7d2c7c596215 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Created volume successfully. Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ca49027-6f2d-48c0-8d6a-5f8403bcb608 req-0bd2f1da-e042-45d5-926f-cfd8b09a99bb tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ca49027-6f2d-48c0-8d6a-5f8403bcb608 req-0bd2f1da-e042-45d5-926f-cfd8b09a99bb tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ca49027-6f2d-48c0-8d6a-5f8403bcb608 req-0bd2f1da-e042-45d5-926f-cfd8b09a99bb tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-9ca49027-6f2d-48c0-8d6a-5f8403bcb608 req-0bd2f1da-e042-45d5-926f-cfd8b09a99bb tempest-AttachVolumeNegativeTest-1569897183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-1a3f2838-b19a-4741-8d15-20f16c0847ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbe2c66e-2efa-4520-92a2-c07e411019ef', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:22:18 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:18 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-9ca49027-6f2d-48c0-8d6a-5f8403bcb608 req-0bd2f1da-e042-45d5-926f-cfd8b09a99bb tempest-AttachVolumeNegativeTest-1569897183 None] attachment_update completed successfully. Nov 04 22:22:19 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.351s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:19 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2263a4b5-9e1b-40aa-87c0-98a2c8ea5707 tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Retype volume completed successfully. Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "cinder-f0f54ab0-7146-472d-9724-8a07b72ff38f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "cinder-f0f54ab0-7146-472d-9724-8a07b72ff38f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "cinder-quobyte-f0f54ab0-7146-472d-9724-8a07b72ff38f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "cinder-quobyte-f0f54ab0-7146-472d-9724-8a07b72ff38f" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[47055e42-7a52-4c9c-a8c7-e58a0d9a28db]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:20 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f Nov 04 22:22:20 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:20 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f" returned: 0 in 0.393s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:20 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f Nov 04 22:22:20 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:20 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f0f54ab0-7146-472d-9724-8a07b72ff38f" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "cinder-quobyte-f0f54ab0-7146-472d-9724-8a07b72ff38f" released by "delete_volume" :: held 0.713s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:20 devstack cinder-volume[87173]: WARNING cinder.quota [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:22:20 devstack cinder-volume[87173]: WARNING cinder.quota [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:22:20 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Created reservations ['ab0c3462-69bd-4eb9-8894-78181dc1058e', 'cecd5574-5168-4779-ae01-19bfb57630c1', 'cc041fda-2581-44f2-a032-19981fef4956', 'b6a80b54-0c68-4a74-84c7-acad94f8282c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:21 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:21 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:21 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.312s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Deleted volume successfully. Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afa22cd2-b17b-453f-9133-60413a7e948c tempest-VolumeRetypeWithoutMigrationTest-1753411335 None] Lock "cinder-f0f54ab0-7146-472d-9724-8a07b72ff38f-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-c0f1ea99-5879-4f85-b6b9-13d58ac02456 req-16adc30d-1a8b-41c9-a26f-4a0e4377231a tempest-AttachVolumeNegativeTest-1569897183 None] Terminate volume connection completed successfully. Nov 04 22:22:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-c0f1ea99-5879-4f85-b6b9-13d58ac02456 req-16adc30d-1a8b-41c9-a26f-4a0e4377231a tempest-AttachVolumeNegativeTest-1569897183 None] Deleting attachment bbe2c66e-2efa-4520-92a2-c07e411019ef. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Flow 'volume_create_manager' (6b3d200e-f30f-45c2-a69e-fd46aa1d0d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf700e2-e93e-488d-a41a-9ce463797804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf700e2-e93e-488d-a41a-9ce463797804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-112820398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e8d806-096c-4013-b131-52e659de1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0120772840d4e9e9068cf855b2805f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:26Z,use_quota=True,user_id='19f7e7a951564d7293b30493984171f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6499b0ee-11b2-45ba-b787-1f8354b08692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6499b0ee-11b2-45ba-b787-1f8354b08692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638b7bbe-91ba-4f88-a1ea-b71a8a3fbcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638b7bbe-91ba-4f88-a1ea-b71a8a3fbcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e8d806-096c-4013-b131-52e659de1275', 'volume_name': 'volume-76e8d806-096c-4013-b131-52e659de1275', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b787b11-fd40-4540-af16-bb08abc1928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b787b11-fd40-4540-af16-bb08abc1928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1564fe8-cfa9-47b5-a764-2a5d45dfa017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:26 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Volume 76e8d806-096c-4013-b131-52e659de1275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e8d806-096c-4013-b131-52e659de1275', 'volume_size': 1} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-112820398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e8d806-096c-4013-b131-52e659de1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0120772840d4e9e9068cf855b2805f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:26Z,use_quota=True,user_id='19f7e7a951564d7293b30493984171f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Creating volume 76e8d806-096c-4013-b131-52e659de1275 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:26 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:26 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 1073741824 Nov 04 22:22:26 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:27 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 1073741824" returned: 0 in 0.553s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:27 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 Nov 04 22:22:27 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-1a3f2838-b19a-4741-8d15-20f16c0847ea-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-1a3f2838-b19a-4741-8d15-20f16c0847ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:27 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275" returned: 0 in 0.352s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1564fe8-cfa9-47b5-a764-2a5d45dfa017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e8d806-096c-4013-b131-52e659de1275', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c09ce5-4edb-47c6-b828-eb3dfd64ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-quobyte-1a3f2838-b19a-4741-8d15-20f16c0847ea" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-1a3f2838-b19a-4741-8d15-20f16c0847ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:27 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Volume volume-76e8d806-096c-4013-b131-52e659de1275 (76e8d806-096c-4013-b131-52e659de1275): created successfully Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c09ce5-4edb-47c6-b828-eb3dfd64ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Flow 'volume_create_manager' (6b3d200e-f30f-45c2-a69e-fd46aa1d0d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f4ee4-6aa9-4b1b-a24e-2a8549aab621]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-793d74f8-93d0-4aeb-baa4-a4d7ad4aa5f2 tempest-ServerActionsTestOtherA-2018913913 None] Created volume successfully. Nov 04 22:22:27 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea Nov 04 22:22:27 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:27 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea" returned: 0 in 0.415s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:28 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea Nov 04 22:22:28 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:28 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1a3f2838-b19a-4741-8d15-20f16c0847ea" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-1a3f2838-b19a-4741-8d15-20f16c0847ea" released by "delete_volume" :: held 0.758s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Created reservations ['18b2f44e-e124-4445-86ce-d6149be40e87', 'b2225e3a-4965-4669-a008-c7bd7e295cae', 'ee6ce219-d1b9-473a-858e-083acda83e23', 'f8ad1954-3398-48f7-b75d-0a547d02b463'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:28 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:28 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:28 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.276s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Deleted volume successfully. Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7dc6e4c-988b-4b70-86bf-001150a402cd tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-1a3f2838-b19a-4741-8d15-20f16c0847ea-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-a427c268-166d-477b-9c32-ede08e1e606a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-a427c268-166d-477b-9c32-ede08e1e606a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-quobyte-a427c268-166d-477b-9c32-ede08e1e606a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-a427c268-166d-477b-9c32-ede08e1e606a" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb38bf6-f7fb-4051-b249-f6601652d32f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:29 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a Nov 04 22:22:29 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:29 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a" returned: 0 in 0.434s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:29 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a Nov 04 22:22:29 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:29 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a427c268-166d-477b-9c32-ede08e1e606a" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-a427c268-166d-477b-9c32-ede08e1e606a" released by "delete_volume" :: held 0.758s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Created reservations ['5a9ad1d8-0c75-44af-a3b0-05f87eb40f00', 'bf791c0a-1593-4b87-9d71-d7b5fe8a27b1', '76cab2d3-8472-4967-aaf8-a62530be9624', 'b80d2512-f5e1-45ba-8bdf-f3b35f7dbaf3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:29 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:29 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:30 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.312s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Deleted volume successfully. Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-121be666-9300-4418-854e-cfab8b707334 tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-a427c268-166d-477b-9c32-ede08e1e606a-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-da8ea633-cc74-4b18-8707-a35af7604bb7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-da8ea633-cc74-4b18-8707-a35af7604bb7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "cinder-quobyte-da8ea633-cc74-4b18-8707-a35af7604bb7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-da8ea633-cc74-4b18-8707-a35af7604bb7" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[995bc853-6501-4b5e-b812-70f4f563c2fe]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:30 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 Nov 04 22:22:30 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:31 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7" returned: 0 in 0.641s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:31 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7 Nov 04 22:22:31 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:31 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da8ea633-cc74-4b18-8707-a35af7604bb7" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-quobyte-da8ea633-cc74-4b18-8707-a35af7604bb7" released by "delete_volume" :: held 1.144s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Created reservations ['9b2e8151-061c-4ade-af03-7942a79f4cce', '16d194a7-411c-4592-b4a8-07000e443f53', '763fd239-4254-4f64-9d69-15c04c7f6dda', '60b5ac7c-037e-47c7-9d04-86dd0cb3014e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:31 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:31 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:32 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.393s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:32 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:32 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Deleted volume successfully. Nov 04 22:22:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-44671c0c-b670-4037-b06e-dcda3eabcc7f tempest-AttachVolumeNegativeTest-1569897183 None] Lock "cinder-da8ea633-cc74-4b18-8707-a35af7604bb7-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (95f60814-48c7-4a91-9ddc-30199aa4798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee5ed3f-0ff2-4969-b056-0ba590f4f81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee5ed3f-0ff2-4969-b056-0ba590f4f81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1503837155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b991a41-6824-4c76-b13d-8ae7f1daf8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:35Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736187f-b9b7-4cf1-9f2b-0418a8fac492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736187f-b9b7-4cf1-9f2b-0418a8fac492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c9a14-e5aa-4f02-9945-7a4b631a5381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c9a14-e5aa-4f02-9945-7a4b631a5381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b991a41-6824-4c76-b13d-8ae7f1daf8af', 'volume_name': 'volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf4fa8-b373-4a41-bccb-deaeef6637b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf4fa8-b373-4a41-bccb-deaeef6637b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0456b412-e029-4dec-89e8-8c78ae43f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:34 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Volume 9b991a41-6824-4c76-b13d-8ae7f1daf8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af', 'volume_size': 1} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1503837155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b991a41-6824-4c76-b13d-8ae7f1daf8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:35Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Creating volume 9b991a41-6824-4c76-b13d-8ae7f1daf8af {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:34 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:34 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af 1073741824 Nov 04 22:22:34 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:35 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af 1073741824" returned: 0 in 0.537s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:35 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af Nov 04 22:22:35 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:35 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0456b412-e029-4dec-89e8-8c78ae43f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b21e22-5573-450a-8c1a-7c777f72b0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Volume volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af (9b991a41-6824-4c76-b13d-8ae7f1daf8af): created successfully Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b21e22-5573-450a-8c1a-7c777f72b0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (95f60814-48c7-4a91-9ddc-30199aa4798b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bf0f6b43-dd27-4ccf-851b-4476b139f655 tempest-AttachVolumeTestJSON-957547757 None] Created volume successfully. Nov 04 22:22:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-97155531-3339-46f6-aefe-a9ebf77df5dd req-e727d685-389e-4d99-8885-1db227a83fe9 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-97155531-3339-46f6-aefe-a9ebf77df5dd req-e727d685-389e-4d99-8885-1db227a83fe9 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-97155531-3339-46f6-aefe-a9ebf77df5dd req-e727d685-389e-4d99-8885-1db227a83fe9 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-97155531-3339-46f6-aefe-a9ebf77df5dd req-e727d685-389e-4d99-8885-1db227a83fe9 tempest-AttachVolumeTestJSON-957547757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c86dbce5-1806-492f-a69f-c680582bcf08', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:22:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-97155531-3339-46f6-aefe-a9ebf77df5dd req-e727d685-389e-4d99-8885-1db227a83fe9 tempest-AttachVolumeTestJSON-957547757 None] attachment_update completed successfully. Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (2f8e06ab-41b1-4998-97ff-bb72537386ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b1606a-da4b-4739-9214-2c873d1341c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b1606a-da4b-4739-9214-2c873d1341c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1205496319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92c900-4db3-4b62-b25a-24c67fef076e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:43Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700b86a8-0f2d-430b-88eb-50c8aaf404ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700b86a8-0f2d-430b-88eb-50c8aaf404ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceac2be-8919-42d3-ae5e-153224a4d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceac2be-8919-42d3-ae5e-153224a4d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca92c900-4db3-4b62-b25a-24c67fef076e', 'volume_name': 'volume-ca92c900-4db3-4b62-b25a-24c67fef076e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96191e91-44a8-48ea-9701-53ea42c8eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96191e91-44a8-48ea-9701-53ea42c8eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be95b2f1-846c-43bf-8cfa-a13d69043126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:42 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Volume ca92c900-4db3-4b62-b25a-24c67fef076e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca92c900-4db3-4b62-b25a-24c67fef076e', 'volume_size': 1} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1205496319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92c900-4db3-4b62-b25a-24c67fef076e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e58923242784378879d99d4b37209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:43Z,use_quota=True,user_id='000016bb96004bb8b4760a9081679518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Creating volume ca92c900-4db3-4b62-b25a-24c67fef076e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:42 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:42 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e 1073741824 Nov 04 22:22:42 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:43 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e 1073741824" returned: 0 in 0.821s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:43 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e Nov 04 22:22:43 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:44 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be95b2f1-846c-43bf-8cfa-a13d69043126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca92c900-4db3-4b62-b25a-24c67fef076e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12e7ff-cf1e-4224-9bb3-46bfd9fe1091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Volume volume-ca92c900-4db3-4b62-b25a-24c67fef076e (ca92c900-4db3-4b62-b25a-24c67fef076e): created successfully Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12e7ff-cf1e-4224-9bb3-46bfd9fe1091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Flow 'volume_create_manager' (2f8e06ab-41b1-4998-97ff-bb72537386ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4e760fdf-efdc-4caf-a6b9-1d5c09fb7dd7 tempest-AttachVolumeTestJSON-957547757 None] Created volume successfully. Nov 04 22:22:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-44d76083-a73b-43d4-bd96-1b017eb80328 req-ee46e311-cd21-49c7-b890-f9c25f4204c5 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-44d76083-a73b-43d4-bd96-1b017eb80328 req-ee46e311-cd21-49c7-b890-f9c25f4204c5 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-44d76083-a73b-43d4-bd96-1b017eb80328 req-ee46e311-cd21-49c7-b890-f9c25f4204c5 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-44d76083-a73b-43d4-bd96-1b017eb80328 req-ee46e311-cd21-49c7-b890-f9c25f4204c5 tempest-AttachVolumeTestJSON-957547757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-ca92c900-4db3-4b62-b25a-24c67fef076e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '826f0b2c-77ec-4cd1-8e1c-048e938405a1', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:22:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-44d76083-a73b-43d4-bd96-1b017eb80328 req-ee46e311-cd21-49c7-b890-f9c25f4204c5 tempest-AttachVolumeTestJSON-957547757 None] attachment_update completed successfully. Nov 04 22:22:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ca099cdc-94c6-47c5-921f-74c7bb153589 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-728897824: creating Nov 04 22:22:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ca099cdc-94c6-47c5-921f-74c7bb153589 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-728897824: created successfully Nov 04 22:22:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ca099cdc-94c6-47c5-921f-74c7bb153589 tempest-GroupSnapshotsTest-1953372399 None] Create group completed successfully. Nov 04 22:22:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-5c9f00c9-54f7-45b9-a66d-0ff226ae19b8 req-2dae3880-b160-4d25-bdb2-e650b5354092 tempest-AttachVolumeTestJSON-957547757 None] Terminate volume connection completed successfully. Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-5c9f00c9-54f7-45b9-a66d-0ff226ae19b8 req-2dae3880-b160-4d25-bdb2-e650b5354092 tempest-AttachVolumeTestJSON-957547757 None] Deleting attachment c86dbce5-1806-492f-a69f-c680582bcf08. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (e642709a-9e86-4d89-bbf8-0926856ba70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220de47-5c79-4239-a93b-253ce44a8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220de47-5c79-4239-a93b-253ce44a8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402254437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=746fc1a5-006a-4840-ad11-e5154391feb2,host='devstack@QuobyteHD#QuobyteHD',id=6cee635f-b110-4c3d-a85c-66a9ee19a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:49Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e8e0a9-c697-4f1d-86a3-802ff0286a61),volume_type_id=65e8e0a9-c697-4f1d-86a3-802ff0286a61)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f082101-3703-4246-8261-4b4887eb39ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f082101-3703-4246-8261-4b4887eb39ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba55788-9abf-4e77-8186-6f99ad91a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba55788-9abf-4e77-8186-6f99ad91a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cee635f-b110-4c3d-a85c-66a9ee19a8b7', 'volume_name': 'volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766b1902-a99c-43cf-90fb-74e4bafd498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766b1902-a99c-43cf-90fb-74e4bafd498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c7b1d7-e9a3-4697-a5ea-f099a52642f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Volume 6cee635f-b110-4c3d-a85c-66a9ee19a8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7', 'volume_size': 1} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=746fc1a5-006a-4840-ad11-e5154391feb2,created_at=2026-11-04T21:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402254437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=746fc1a5-006a-4840-ad11-e5154391feb2,host='devstack@QuobyteHD#QuobyteHD',id=6cee635f-b110-4c3d-a85c-66a9ee19a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:49Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e8e0a9-c697-4f1d-86a3-802ff0286a61),volume_type_id=65e8e0a9-c697-4f1d-86a3-802ff0286a61)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Creating volume 6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:49 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:49 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 1073741824 Nov 04 22:22:49 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:50 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 1073741824" returned: 0 in 0.657s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:50 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:22:50 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-2eab14ab-820c-449f-b524-ab0013e90f75 req-bde9a17a-e991-44e9-a90a-f9a8153de225 tempest-AttachVolumeTestJSON-957547757 None] Terminate volume connection completed successfully. Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-2eab14ab-820c-449f-b524-ab0013e90f75 req-bde9a17a-e991-44e9-a90a-f9a8153de225 tempest-AttachVolumeTestJSON-957547757 None] Deleting attachment 826f0b2c-77ec-4cd1-8e1c-048e938405a1. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:22:50 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.410s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c7b1d7-e9a3-4697-a5ea-f099a52642f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c41c0-3099-4120-a438-acaefa965f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Volume volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 (6cee635f-b110-4c3d-a85c-66a9ee19a8b7): created successfully Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c41c0-3099-4120-a438-acaefa965f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (e642709a-9e86-4d89-bbf8-0926856ba70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1bd75b22-753f-4a96-9b30-129464d760ed tempest-GroupSnapshotsTest-1953372399 None] Created volume successfully. Nov 04 22:22:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] GroupSnapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: creating. Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Group snapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: creating. {{(pid=87173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Creating offline snapshot 17caf141-dece-4836-9235-8b1064482757 of volume 6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c71a83-472b-4849-9d52-e23ea0beacbd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:52 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:22:52 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Flow 'volume_create_manager' (b3ce2ac7-6e07-4c14-a677-bf56b0bf6815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780ddbb4-3f2e-40d0-b7d0-89c6050a63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780ddbb4-3f2e-40d0-b7d0-89c6050a63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723452450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43528001-191e-4de9-a83d-4e732b5342b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af0b42809c4ef18a80bbe5064dae48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:53Z,use_quota=True,user_id='d89504bac82147bf87b3ea47706996bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3dc260-1ed7-4692-b18f-edaea87f6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:52 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3dc260-1ed7-4692-b18f-edaea87f6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb4273a-c34c-4d73-b2d1-c41d3caf43fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb4273a-c34c-4d73-b2d1-c41d3caf43fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43528001-191e-4de9-a83d-4e732b5342b6', 'volume_name': 'volume-43528001-191e-4de9-a83d-4e732b5342b6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16982089-d9a6-46b7-8058-6bdf593e7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16982089-d9a6-46b7-8058-6bdf593e7019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee882b5-622e-4deb-854d-087ad9929e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:53 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Volume 43528001-191e-4de9-a83d-4e732b5342b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43528001-191e-4de9-a83d-4e732b5342b6', 'volume_size': 1} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.495s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:53 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 1G Nov 04 22:22:53 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:53 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 1G" returned: 0 in 0.430s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:53 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:22:53 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:53 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.318s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:53 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:22:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:53 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:22:53 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:54 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:54 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info Nov 04 22:22:54 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:54 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:54 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:54 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info Nov 04 22:22:54 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:54 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.info" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723452450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43528001-191e-4de9-a83d-4e732b5342b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af0b42809c4ef18a80bbe5064dae48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:22:53Z,use_quota=True,user_id='d89504bac82147bf87b3ea47706996bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Creating volume 43528001-191e-4de9-a83d-4e732b5342b6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:54 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:22:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:54 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 1073741824 Nov 04 22:22:54 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a20c12da-edad-4e16-9813-89bf42ad9a72 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: created successfully Nov 04 22:22:55 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 1073741824" returned: 0 in 0.400s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:55 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 Nov 04 22:22:55 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:55 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee882b5-622e-4deb-854d-087ad9929e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43528001-191e-4de9-a83d-4e732b5342b6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdb7c56-854a-4c7f-b81e-37b79a0cf550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:22:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Volume volume-43528001-191e-4de9-a83d-4e732b5342b6 (43528001-191e-4de9-a83d-4e732b5342b6): created successfully Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdb7c56-854a-4c7f-b81e-37b79a0cf550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:22:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Flow 'volume_create_manager' (b3ce2ac7-6e07-4c14-a677-bf56b0bf6815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:22:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-10415fc0-bc3c-498d-b345-00747a510ecd tempest-VolumesTransfersTest-929862744 None] Created volume successfully. Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-ca92c900-4db3-4b62-b25a-24c67fef076e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757-89b74499-f06a-4f61-b6d0-e884faa3c8c2" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-ca92c900-4db3-4b62-b25a-24c67fef076e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:56 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:56 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757-89b74499-f06a-4f61-b6d0-e884faa3c8c2" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Creating volume 89b74499-f06a-4f61-b6d0-e884faa3c8c2 from snapshot 17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] snapshot: 17caf141-dece-4836-9235-8b1064482757, volume: 89b74499-f06a-4f61-b6d0-e884faa3c8c2, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-quobyte-ca92c900-4db3-4b62-b25a-24c67fef076e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee20c53-c60f-44dd-9527-0e6fa9ec4330]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-ca92c900-4db3-4b62-b25a-24c67fef076e" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-53c66a30-0ebd-44a9-ae2e-f1d06039a7b4 tempest-VolumesTransfersTest-1399641974 None] Transfer volume completed successfully. Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c8458-b38d-46d0-8d79-c56cd2f9c2b0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:56 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:22:56 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:56 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 8 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:22:57 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e Nov 04 22:22:57 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:57 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e" returned: 0 in 0.475s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:57 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.550s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:22:57 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e Nov 04 22:22:57 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c99a1e-dc5f-40c9-ba23-3a1714eff57a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:57 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:22:57 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:57 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "cinder-43528001-191e-4de9-a83d-4e732b5342b6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ca92c900-4db3-4b62-b25a-24c67fef076e" returned: 0 in 0.315s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-43528001-191e-4de9-a83d-4e732b5342b6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-ca92c900-4db3-4b62-b25a-24c67fef076e" released by "delete_volume" :: held 0.879s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "cinder-quobyte-43528001-191e-4de9-a83d-4e732b5342b6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Created reservations ['8c53fec3-cc5f-4771-b973-5359932a9d4f', 'b3036598-a517-473f-862c-e7f18c5d06b8', '90727623-81d4-43ce-a5fa-4d0919a4a667', '297f9aa5-2d09-4b77-a008-45de810b582d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-quobyte-43528001-191e-4de9-a83d-4e732b5342b6" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fc473-d07a-4e9d-b35c-67a1928d5b4f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:57 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.471s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:57 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 Nov 04 22:22:57 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:57 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 Nov 04 22:22:57 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:57 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:57 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:58 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.326s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Deleted volume successfully. Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-9b991a41-6824-4c76-b13d-8ae7f1daf8af-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-986d1312-f77f-456b-ba90-a6d9f9f76d3e tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-ca92c900-4db3-4b62-b25a-24c67fef076e-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-9b991a41-6824-4c76-b13d-8ae7f1daf8af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-quobyte-9b991a41-6824-4c76-b13d-8ae7f1daf8af" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:22:58 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6" returned: 0 in 0.560s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-9b991a41-6824-4c76-b13d-8ae7f1daf8af" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:22:58 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6 Nov 04 22:22:58 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e4321-bb0a-4952-894d-52ac2c996fae]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:58 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af Nov 04 22:22:58 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:58 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-43528001-191e-4de9-a83d-4e732b5342b6" returned: 0 in 0.466s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-quobyte-43528001-191e-4de9-a83d-4e732b5342b6" released by "delete_volume" :: held 1.117s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Created reservations ['1323baa2-6edf-4885-a4e7-def9b82428c1', 'a327b705-65d0-4e94-94c5-32b5c3348e60', 'd1daa1df-c1cb-4bb7-9865-d067ce077efa', '8c159dd3-f28f-4df1-8aa6-7e2969e5d4e4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:59 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:22:59 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:59 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af" returned: 0 in 0.940s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:22:59 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af Nov 04 22:22:59 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:22:59 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.560s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:22:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Deleted volume successfully. Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe29b828-be61-48af-8a12-43ee9cff66d8 tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-43528001-191e-4de9-a83d-4e732b5342b6-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:22:59 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9b991a41-6824-4c76-b13d-8ae7f1daf8af" returned: 0 in 0.555s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:22:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-9b991a41-6824-4c76-b13d-8ae7f1daf8af" released by "delete_volume" :: held 1.560s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Created reservations ['b25bedff-cc58-4420-a5fc-531dc02f1de9', '08a8508c-4eae-47b2-8098-712a5ddcc70d', '38142d82-678e-4f29-9e65-ac6ae78e6c11', 'c3e3c15d-8ac8-4faf-a1c2-74ca11076a2c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:00 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:00 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:00 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.386s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Deleted volume successfully. Nov 04 22:23:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b609d23-5f54-4879-97db-831b1c93aa97 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-9b991a41-6824-4c76-b13d-8ae7f1daf8af-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "cinder-quobyte-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" acquired by "delete_volume" :: waited 0.039s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ff46b-2b32-424e-ac17-ba0b0e5db16e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Flow 'volume_create_manager' (ba845178-2f4f-4721-98aa-34edd00c68ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fbbfd4-ea26-43c5-9506-69f530107468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:01 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 Nov 04 22:23:01 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fbbfd4-ea26-43c5-9506-69f530107468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1035621105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ff851-8b94-4ea9-bf28-1cb7e9103681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af0b42809c4ef18a80bbe5064dae48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:01Z,use_quota=True,user_id='d89504bac82147bf87b3ea47706996bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca646778-f426-43ef-b5e8-8aa8296da50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca646778-f426-43ef-b5e8-8aa8296da50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a9352c-9d69-472c-b098-797766c19672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a9352c-9d69-472c-b098-797766c19672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ff851-8b94-4ea9-bf28-1cb7e9103681', 'volume_name': 'volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4672aae4-b79c-4e66-bba2-421208785727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4672aae4-b79c-4e66-bba2-421208785727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f323f6c5-2df6-4394-a142-b394224c1d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:01 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Volume b54ff851-8b94-4ea9-bf28-1cb7e9103681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681', 'volume_size': 1} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:01 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" returned: 0 in 0.635s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:02 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3 Nov 04 22:23:02 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:02 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" returned: 0 in 0.454s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-quobyte-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3" released by "delete_volume" :: held 1.213s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Created reservations ['b0f95c1f-7bbd-4e28-a8ec-cb6ddc27c059', 'ce1fe4a5-fe1e-44cd-b8d9-d809cfdb51f3', '74092e69-820b-458c-963d-f69c8cb7f25a', '3255a1ac-c56f-48e6-8ba1-d8b96d7d0504'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:02 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:02 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:03 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.336s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:03 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Deleted volume successfully. Nov 04 22:23:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3d385295-3673-46b9-adb3-12aa57554cb6 tempest-AttachVolumeTestJSON-957547757 None] Lock "cinder-cab2d0ac-5a8f-45ba-8927-d9bfae3d74a3-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-08ed1f50-b25c-47bb-b78c-609acc69a0d6 req-ed4f191a-ca4e-4f6f-a4c2-9af44052a9d3 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:06 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2" returned: 0 in 8.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:23:06 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Converted 1024.00 MB image at 121.23 MB/s Nov 04 22:23:06 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:06 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 Nov 04 22:23:06 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:06 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" released by "_copy_volume_from_snapshot" :: held 9.852s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757-89b74499-f06a-4f61-b6d0-e884faa3c8c2" released by "_create_volume_from_snapshot" :: held 9.935s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.969s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.976s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1035621105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ff851-8b94-4ea9-bf28-1cb7e9103681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af0b42809c4ef18a80bbe5064dae48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:01Z,use_quota=True,user_id='d89504bac82147bf87b3ea47706996bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Creating volume b54ff851-8b94-4ea9-bf28-1cb7e9103681 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:06 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:06 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 1073741824 Nov 04 22:23:06 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e47218d3-1b00-4b2d-aec1-7becab80146d tempest-GroupSnapshotsTest-1953372399 None] Create group from source-snapshot-97571875-59be-4c86-b3f7-ce1c5e1f0e60 completed successfully. Nov 04 22:23:07 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 1073741824" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:07 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 Nov 04 22:23:07 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:07 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681" returned: 0 in 0.268s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-08ed1f50-b25c-47bb-b78c-609acc69a0d6 req-ed4f191a-ca4e-4f6f-a4c2-9af44052a9d3 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.507s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f323f6c5-2df6-4394-a142-b394224c1d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcc305-ab61-4634-b1e1-7769f44631f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-08ed1f50-b25c-47bb-b78c-609acc69a0d6 req-ed4f191a-ca4e-4f6f-a4c2-9af44052a9d3 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Volume volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 (b54ff851-8b94-4ea9-bf28-1cb7e9103681): created successfully Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcc305-ab61-4634-b1e1-7769f44631f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Flow 'volume_create_manager' (ba845178-2f4f-4721-98aa-34edd00c68ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-08ed1f50-b25c-47bb-b78c-609acc69a0d6 req-ed4f191a-ca4e-4f6f-a4c2-9af44052a9d3 tempest-ServerActionsTestOtherA-2018913913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-76e8d806-096c-4013-b131-52e659de1275', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd4ede6d-5e7f-4849-ac51-8995e9c1038c', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:23:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4711dcdf-f304-4dfd-a69a-c87d623d4df4 tempest-VolumesTransfersTest-929862744 None] Created volume successfully. Nov 04 22:23:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-08ed1f50-b25c-47bb-b78c-609acc69a0d6 req-ed4f191a-ca4e-4f6f-a4c2-9af44052a9d3 tempest-ServerActionsTestOtherA-2018913913 None] attachment_update completed successfully. Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "cinder-b54ff851-8b94-4ea9-bf28-1cb7e9103681-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-b54ff851-8b94-4ea9-bf28-1cb7e9103681-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "cinder-quobyte-b54ff851-8b94-4ea9-bf28-1cb7e9103681" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-quobyte-b54ff851-8b94-4ea9-bf28-1cb7e9103681" acquired by "delete_volume" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" acquired by "delete_volume" :: waited 0.066s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a5d0de-c2d5-47c2-8338-1cb0320e39df]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[678dd722-33c8-437e-8f35-deaaa62dad9f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:08 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 Nov 04 22:23:08 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:08 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 Nov 04 22:23:08 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:08 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2" returned: 0 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:08 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2 Nov 04 22:23:08 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:08 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681" returned: 0 in 0.662s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:08 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681 Nov 04 22:23:08 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:09 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-89b74499-f06a-4f61-b6d0-e884faa3c8c2" returned: 0 in 0.307s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-89b74499-f06a-4f61-b6d0-e884faa3c8c2" released by "delete_volume" :: held 0.896s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['a4d11e57-c9ad-4516-9525-b4195aba542d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:09 devstack cinder-volume[87173]: WARNING cinder.quota [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-702799261 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-702799261, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:09 devstack cinder-volume[87173]: WARNING cinder.quota [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-702799261 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-702799261, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['5428da4d-548e-4048-bf93-aa2561049798', '51cc9f00-898c-4f24-b1e1-b297a22006e4', '3ba2a7a8-e40a-4c74-8080-40462df5328f', '68cd059f-3d36-4150-b009-11e1d8c59ce7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:09 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b54ff851-8b94-4ea9-bf28-1cb7e9103681" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-quobyte-b54ff851-8b94-4ea9-bf28-1cb7e9103681" released by "delete_volume" :: held 1.118s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Created reservations ['2e3fbcc2-e6ff-4742-8ea4-fab30192f82f', 'cfc303a5-865e-47c1-98db-09992896d655', 'fc5677a5-a8ed-4909-99bb-02c55b2d9e93', '64936175-1652-440b-bdef-c8a66b4f23f0'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:09 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:09 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:09 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:09 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:09 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.340s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fc1fbab3-d042-4472-a5fc-bb2b1a3638da tempest-GroupSnapshotsTest-1953372399 None] Delete group completed successfully. Nov 04 22:23:09 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Deleted volume successfully. Nov 04 22:23:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2f3d9d6-c223-4f31-8384-80a53784b67a tempest-VolumesTransfersTest-1002227282 None] Lock "cinder-b54ff851-8b94-4ea9-bf28-1cb7e9103681-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: deleting Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: deleting {{(pid=87173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Deleting offline snapshot 17caf141-dece-4836-9235-8b1064482757 of volume 6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] snapshot_file for this snap is: volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc04dc0-6df8-4a3b-ba70-cb019e4285e2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:11 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:23:11 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-51c6b5fc-a372-4e7c-a92f-fc094d34f82b tempest-ServerActionsTestOtherA-2018913913 None] Terminate volume connection completed successfully. Nov 04 22:23:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-51c6b5fc-a372-4e7c-a92f-fc094d34f82b tempest-ServerActionsTestOtherA-2018913913 None] Deleting attachment cd4ede6d-5e7f-4849-ac51-8995e9c1038c. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:23:11 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.614s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:23:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[614fc6c2-1554-4621-8096-0cbef1dbc441]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:11 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:23:11 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:12 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.952s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:12 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:23:12 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-915a2321-39f6-4f38-b385-3d02ebc2cb6c tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-915a2321-39f6-4f38-b385-3d02ebc2cb6c tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-915a2321-39f6-4f38-b385-3d02ebc2cb6c tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-915a2321-39f6-4f38-b385-3d02ebc2cb6c tempest-ServerActionsTestOtherA-2018913913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-76e8d806-096c-4013-b131-52e659de1275', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5902f337-a132-4556-a62f-13ed9573ea50', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:23:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-0869c184-a3b1-46cf-af4a-0c52894ebd15 req-915a2321-39f6-4f38-b385-3d02ebc2cb6c tempest-ServerActionsTestOtherA-2018913913 None] attachment_update completed successfully. Nov 04 22:23:13 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.515s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:13 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757 Nov 04 22:23:13 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:13 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7.17caf141-dece-4836-9235-8b1064482757" returned: 0 in 0.330s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-17caf141-dece-4836-9235-8b1064482757" released by "_delete_snapshot" :: held 2.687s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" released by "delete_snapshot" :: held 2.730s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:13 devstack cinder-volume[87173]: WARNING cinder.quota [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-702799261 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-702799261, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['cae07cf8-6bb6-4a04-9577-e24b2c0996f7', 'd12009d7-d101-4be2-a003-98f5ce3a9dd9', '95dac456-e41b-4bfd-8f46-f7c7b79fb697', 'e692dd17-eade-407d-b87a-cc1ddc7b52ed'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2a12ddda-c9a6-4665-9d58-e3ab2430964e tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 97571875-59be-4c86-b3f7-ce1c5e1f0e60: deleted successfully Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=137,cinder:UPDATE=132,cinder:INSERT=28,cinder:DELETE=11 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=131,cinder:UPDATE=130,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" acquired by "delete_volume" :: waited 0.071s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f338a-5639-4d23-8a88-32d3db9db59f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:15 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:23:15 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:15 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.853s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:15 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7 Nov 04 22:23:15 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:16 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" returned: 0 in 0.455s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-6cee635f-b110-4c3d-a85c-66a9ee19a8b7" released by "delete_volume" :: held 1.467s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['68eb7c18-4759-4634-956f-227905778f0d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:16 devstack cinder-volume[87173]: WARNING cinder.db.api [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-702799261'] Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['41dbd80f-5aed-4cc1-a57d-bb9ca4d1fdd7', '80b4651a-e402-401f-b1be-735d7c8d106a', '35070724-6023-41f1-ba4d-1cc6c87f5248', 'ef172d4a-280f-4266-8d6c-30fb07d25433'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:16 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:16 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:16 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.338s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0b7f3171-10a9-4f24-89a7-c4e0a4f82111 tempest-GroupSnapshotsTest-1953372399 None] Delete group completed successfully. Nov 04 22:23:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f5bbbef5-5968-406a-a24a-487bc8935102 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-833172547: creating Nov 04 22:23:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f5bbbef5-5968-406a-a24a-487bc8935102 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-833172547: created successfully Nov 04 22:23:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f5bbbef5-5968-406a-a24a-487bc8935102 tempest-GroupSnapshotsTest-1953372399 None] Create group completed successfully. Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (8882544b-5cfb-4f3b-bfe8-cb12517a8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b8d9f2-6047-4b6d-a640-79d24f026513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b8d9f2-6047-4b6d-a640-79d24f026513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865699051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,host='devstack@QuobyteHD#QuobyteHD',id=9e4eefe3-ebfe-465e-be81-8af7d9f42846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:20Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(821fe0e3-e22c-4322-9769-5e892ad40b5a),volume_type_id=821fe0e3-e22c-4322-9769-5e892ad40b5a)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14503d30-0a2d-4d85-9dce-df8eff1bf783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14503d30-0a2d-4d85-9dce-df8eff1bf783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e881f8-6c03-4bf0-8be8-72fe79b3c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e881f8-6c03-4bf0-8be8-72fe79b3c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4eefe3-ebfe-465e-be81-8af7d9f42846', 'volume_name': 'volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9235c9e1-4b77-489e-ae75-c976c1460d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9235c9e1-4b77-489e-ae75-c976c1460d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d91dda-04d2-4702-8cfe-b68049bb5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:20 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Volume 9e4eefe3-ebfe-465e-be81-8af7d9f42846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846', 'volume_size': 1} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,created_at=2026-11-04T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865699051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,host='devstack@QuobyteHD#QuobyteHD',id=9e4eefe3-ebfe-465e-be81-8af7d9f42846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:20Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(821fe0e3-e22c-4322-9769-5e892ad40b5a),volume_type_id=821fe0e3-e22c-4322-9769-5e892ad40b5a)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Creating volume 9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:20 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:20 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 1073741824 Nov 04 22:23:20 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:20 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 1073741824" returned: 0 in 0.558s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:21 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 Nov 04 22:23:21 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:21 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d91dda-04d2-4702-8cfe-b68049bb5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721b3dc8-2ed7-485d-9d29-59d212efc688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Volume volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 (9e4eefe3-ebfe-465e-be81-8af7d9f42846): created successfully Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721b3dc8-2ed7-485d-9d29-59d212efc688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (8882544b-5cfb-4f3b-bfe8-cb12517a8189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8d2ef006-4e50-4bf5-bec8-76a8d7f9f09e tempest-GroupSnapshotsTest-1953372399 None] Created volume successfully. Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Flow 'volume_create_manager' (376374c2-0562-4182-b26e-aa590cce7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d647ca00-956d-46d9-934b-6e05ee610c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d647ca00-956d-46d9-934b-6e05ee610c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-460094581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fa0c5960c14cc4bc14eb21c7397952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:22Z,use_quota=True,user_id='8c10f2b1ed4e4e858f89613c1559a163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0379184c-c9d2-4225-bbf7-b35c1e85a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0379184c-c9d2-4225-bbf7-b35c1e85a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211e81d1-a7c1-4cfe-b037-0d75e81f04e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211e81d1-a7c1-4cfe-b037-0d75e81f04e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'volume_name': 'volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a81d14f-4c6d-4c93-9171-a0d3dd52979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a81d14f-4c6d-4c93-9171-a0d3dd52979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283afd32-6bcf-4888-8665-d6c9f5a174f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Volume 6cddb7b8-7ab4-4cc0-b24d-851fa8401c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'volume_size': 1} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-460094581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fa0c5960c14cc4bc14eb21c7397952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:22Z,use_quota=True,user_id='8c10f2b1ed4e4e858f89613c1559a163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Creating volume 6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:22 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 1073741824 Nov 04 22:23:22 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:22 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 1073741824" returned: 0 in 0.511s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:22 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:22 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:22 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.407s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283afd32-6bcf-4888-8665-d6c9f5a174f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5767d1b0-335e-4e2b-8e5f-1cf3cf7cae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Volume volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 (6cddb7b8-7ab4-4cc0-b24d-851fa8401c00): created successfully Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5767d1b0-335e-4e2b-8e5f-1cf3cf7cae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Flow 'volume_create_manager' (376374c2-0562-4182-b26e-aa590cce7c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f45d3118-1309-49f4-95c2-77e8ee390bf5 tempest-VolumesCloneTest-979369376 None] Created volume successfully. Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (2d9cefe3-ee89-4ba7-9eb0-040ecb55fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5aa4ea-815a-4f73-a22d-e8d87ab15d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5aa4ea-815a-4f73-a22d-e8d87ab15d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1843312955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,host='devstack@QuobyteHD#QuobyteHD',id=aa849e8d-956e-43f2-96d3-72502c01cd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:23Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(821fe0e3-e22c-4322-9769-5e892ad40b5a),volume_type_id=821fe0e3-e22c-4322-9769-5e892ad40b5a)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9579fa7e-e010-4fd6-8cab-2a350c9d0ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9579fa7e-e010-4fd6-8cab-2a350c9d0ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3462f0a1-0aee-4280-8d92-5148a64a62cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3462f0a1-0aee-4280-8d92-5148a64a62cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa849e8d-956e-43f2-96d3-72502c01cd80', 'volume_name': 'volume-aa849e8d-956e-43f2-96d3-72502c01cd80', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867b39c4-ecc3-4d01-bddf-ef8ca8f56b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867b39c4-ecc3-4d01-bddf-ef8ca8f56b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6344ce-c26a-4878-ab5d-d5e58fa3726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Volume aa849e8d-956e-43f2-96d3-72502c01cd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa849e8d-956e-43f2-96d3-72502c01cd80', 'volume_size': 1} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,created_at=2026-11-04T21:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1843312955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eaedec4-b819-42ca-a431-5b0b55dedf86,host='devstack@QuobyteHD#QuobyteHD',id=aa849e8d-956e-43f2-96d3-72502c01cd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:23Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(821fe0e3-e22c-4322-9769-5e892ad40b5a),volume_type_id=821fe0e3-e22c-4322-9769-5e892ad40b5a)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Creating volume aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:23 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:23 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 1073741824 Nov 04 22:23:23 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:23 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 1073741824" returned: 0 in 0.497s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:24 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 Nov 04 22:23:24 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:24 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6344ce-c26a-4878-ab5d-d5e58fa3726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa849e8d-956e-43f2-96d3-72502c01cd80', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e983db6-7c50-4c37-a936-4407214278f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Volume volume-aa849e8d-956e-43f2-96d3-72502c01cd80 (aa849e8d-956e-43f2-96d3-72502c01cd80): created successfully Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e983db6-7c50-4c37-a936-4407214278f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (2d9cefe3-ee89-4ba7-9eb0-040ecb55fba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8f54771c-58dc-46bc-a657-579ac916dde5 tempest-GroupSnapshotsTest-1953372399 None] Created volume successfully. Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Flow 'volume_create_manager' (ff4b3289-ff26-4b97-9c7b-e9de3fd11312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb944a8-e76a-4c6d-9f05-908a1e6481df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb944a8-e76a-4c6d-9f05-908a1e6481df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1023599609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e4bfd7-0ae8-46c5-81e2-e6729c7b8276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fa0c5960c14cc4bc14eb21c7397952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:25Z,use_quota=True,user_id='8c10f2b1ed4e4e858f89613c1559a163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4088d0ad-1b23-41fb-b110-8851c9875456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4088d0ad-1b23-41fb-b110-8851c9875456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab1746-a1da-4232-b430-7c90fc3bf9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab1746-a1da-4232-b430-7c90fc3bf9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77e4bfd7-0ae8-46c5-81e2-e6729c7b8276', 'volume_name': 'volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276', 'volume_size': 2, 'source_volid': '6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'source_volstatus': 'available'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c716efea-1626-4c6f-a41c-193f6de81f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c716efea-1626-4c6f-a41c-193f6de81f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ba4e52-cc2e-4b59-aebb-4e7a0390ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Volume 77e4bfd7-0ae8-46c5-81e2-e6729c7b8276: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276', 'volume_size': 2, 'source_volid': '6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'source_volstatus': 'available'} Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:25 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Cloning volume 6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 to volume 77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Creating offline snapshot d69a1ebb-aa64-46b2-b798-5fdaf505d170 of volume 6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b82c2-5957-4238-905f-931214e9917f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:25 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:25 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:25 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:25 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 1G Nov 04 22:23:25 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1cda756d-2be2-440f-a158-095db32da15e tempest-GroupSnapshotsTest-1953372399 None] Update group completed successfully. Nov 04 22:23:26 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 1G" returned: 0 in 0.590s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:26 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:26 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:26 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.342s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:26 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 is being set with open permissions: ugo+rw Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:26 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:26 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:26 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:26 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info Nov 04 22:23:26 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:27 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:27 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info is being set with open permissions: ugo+rw Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:27 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info Nov 04 22:23:27 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-01ff2d84-31a3-4431-afa7-5b07ffb7eebd tempest-GroupSnapshotsTest-1953372399 None] Update group completed successfully. Nov 04 22:23:27 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.info" returned: 0 in 0.310s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] snapshot: d69a1ebb-aa64-46b2-b798-5fdaf505d170, volume: 77e4bfd7-0ae8-46c5-81e2-e6729c7b8276, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[158e6b38-b7fd-49bd-90cc-cdf11266b239]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:27 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:27 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:27 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.432s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97cab6-b02f-4d5c-b30c-0ae2a66afaee]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:28 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:28 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:28 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.465s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:23:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:23:28 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:23:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:28 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 Nov 04 22:23:28 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2fbb70c4-5151-4555-a402-9cdbd5eab41c tempest-GroupSnapshotsTest-1953372399 None] Update group completed successfully. Nov 04 22:23:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-460baaa9-c00d-4086-9e3f-8bbb61389273 tempest-GroupSnapshotsTest-1953372399 None] Update group completed successfully. Nov 04 22:23:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] GroupSnapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: creating. Nov 04 22:23:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Group snapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: creating. {{(pid=87173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 22:23:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9e619451-aa97-4c18-ab1e-9f59f50c0b9f tempest-GroupsTest-1336917547 None] Group tempest-Group1-1142223577: creating Nov 04 22:23:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9e619451-aa97-4c18-ab1e-9f59f50c0b9f tempest-GroupsTest-1336917547 None] Group tempest-Group1-1142223577: created successfully Nov 04 22:23:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9e619451-aa97-4c18-ab1e-9f59f50c0b9f tempest-GroupsTest-1336917547 None] Create group completed successfully. Nov 04 22:23:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0ca23bea-cb47-4655-a333-b0f4fcf3fc6b tempest-GroupsTest-1336917547 None] Group tempest-Group2-312211165: creating Nov 04 22:23:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0ca23bea-cb47-4655-a333-b0f4fcf3fc6b tempest-GroupsTest-1336917547 None] Group tempest-Group2-312211165: created successfully Nov 04 22:23:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0ca23bea-cb47-4655-a333-b0f4fcf3fc6b tempest-GroupsTest-1336917547 None] Create group completed successfully. Nov 04 22:23:36 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" returned: 0 in 7.915s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:23:36 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Converted 1024.00 MB image at 129.36 MB/s Nov 04 22:23:36 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 is being set with open permissions: ugo+rw Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:36 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 Nov 04 22:23:36 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:36 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" released by "_copy_volume_from_snapshot" :: held 9.171s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-quobyte-d69a1ebb-aa64-46b2-b798-5fdaf505d170" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-d69a1ebb-aa64-46b2-b798-5fdaf505d170" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Deleting offline snapshot d69a1ebb-aa64-46b2-b798-5fdaf505d170 of volume 6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] snapshot_file for this snap is: volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f5f23a-6786-45a3-8114-9d5d48cb79c0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:36 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:36 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:37 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.452s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[495535e7-7a30-4fb0-93f4-3cf2f8ee5741]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:37 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:37 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (4e67d914-1fc3-4333-9412-fe534ad67687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2ccd8-eacc-4857-ba9a-1f84f3b0ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2ccd8-eacc-4857-ba9a-1f84f3b0ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025834071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58e027d0-5461-4fa3-815f-ec4e25554e88,host='devstack@QuobyteHD#QuobyteHD',id=1b0c93fc-f0ba-40e4-9abe-68b132318886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:37Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38d37afa-79af-4ccc-880c-afda84fcdab6),volume_type_id=38d37afa-79af-4ccc-880c-afda84fcdab6)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4779ba3-05e3-49bb-8203-7757a280d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4779ba3-05e3-49bb-8203-7757a280d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79114e28-3ea7-4f63-872c-3cfe93c4f62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79114e28-3ea7-4f63-872c-3cfe93c4f62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0c93fc-f0ba-40e4-9abe-68b132318886', 'volume_name': 'volume-1b0c93fc-f0ba-40e4-9abe-68b132318886', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc0a13f-c3bd-42ba-a88b-ef71c4f16169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc0a13f-c3bd-42ba-a88b-ef71c4f16169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3610f1-a7c6-421e-996a-fe3aba01c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Volume 1b0c93fc-f0ba-40e4-9abe-68b132318886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0c93fc-f0ba-40e4-9abe-68b132318886', 'volume_size': 1} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:37 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.583s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:37 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:37 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:38 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:38 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170 Nov 04 22:23:38 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:38 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00.d69a1ebb-aa64-46b2-b798-5fdaf505d170" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-d69a1ebb-aa64-46b2-b798-5fdaf505d170" released by "_delete_snapshot" :: held 1.790s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.442s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.504s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ba4e52-cc2e-4b59-aebb-4e7a0390ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276', 'volume_size': 2, 'source_volid': '6cddb7b8-7ab4-4cc0-b24d-851fa8401c00', 'source_volstatus': 'available'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800214bf-ae85-472c-a96f-5515b3d9687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Creating offline snapshot 0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 of volume aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:23:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Volume volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 (77e4bfd7-0ae8-46c5-81e2-e6729c7b8276): created successfully Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800214bf-ae85-472c-a96f-5515b3d9687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Flow 'volume_create_manager' (ff4b3289-ff26-4b97-9c7b-e9de3fd11312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a79c8-ea79-4e87-846b-8d29fa1872f3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-368eac59-0362-40f4-ac21-7e284653c6a6 tempest-VolumesCloneTest-979369376 None] Created volume successfully. Nov 04 22:23:38 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 Nov 04 22:23:38 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:38 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:38 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 1G Nov 04 22:23:38 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:39 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 1G" returned: 0 in 0.505s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa849e8d-956e-43f2-96d3-72502c01cd80 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:39 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa849e8d-956e-43f2-96d3-72502c01cd80 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 Nov 04 22:23:39 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "cinder-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954dfc7-2491-497b-9049-82f4cf963291]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:39 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 Nov 04 22:23:39 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:39 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa849e8d-956e-43f2-96d3-72502c01cd80 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" returned: 0 in 0.405s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:39 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:39 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 Nov 04 22:23:39 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:39 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:39 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276 Nov 04 22:23:39 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:40 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:40 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info Nov 04 22:23:40 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:40 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276" released by "delete_volume" :: held 0.775s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Created reservations ['5715775d-df47-45f6-833f-a8072f917ce8', '653c346e-4d29-4382-a7b7-fcb104d113a3', '30a32d03-4aa8-48c6-9ebf-840505e0fe93', '8bed995e-9319-4ccc-99d6-7fcc4c566b47'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:40 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info" returned: 0 in 0.321s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:40 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:40 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:40 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:40 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info Nov 04 22:23:40 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-135d16cc-65e3-43a5-a911-87d50ee216f0 req-f2d33e77-73dc-4eca-a776-b7c66fb5c3cf tempest-ServerActionsTestOtherA-2018913913 None] Terminate volume connection completed successfully. Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-135d16cc-65e3-43a5-a911-87d50ee216f0 req-f2d33e77-73dc-4eca-a776-b7c66fb5c3cf tempest-ServerActionsTestOtherA-2018913913 None] Deleting attachment 5902f337-a132-4556-a62f-13ed9573ea50. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:40 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "cinder-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.338s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Deleted volume successfully. Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8eab3f4f-aae4-4c7c-ae21-d5ccb8077bdf tempest-VolumesCloneTest-979369376 None] Lock "cinder-77e4bfd7-0ae8-46c5-81e2-e6729c7b8276-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:40 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.info" returned: 0 in 0.381s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Acquiring lock "cinder-quobyte-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Creating offline snapshot c3c07c9d-d61d-4bc5-a70b-fc9770545b6e of volume 9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[58251f95-db24-443b-88cc-77473bf0ad9b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda7047-fe25-4159-a024-bd74fe6f865d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:41 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 Nov 04 22:23:41 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:41 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:41 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:41 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846" returned: 0 in 0.473s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:41 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.464s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:41 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e 1G Nov 04 22:23:41 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:41 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00 Nov 04 22:23:41 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:41 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "cinder-quobyte-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00" released by "delete_volume" :: held 0.987s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:41 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Created reservations ['ed26d610-0c2c-47a4-a380-1dc815ee0780', '8347f0c6-4d0c-42dd-b3f7-0ec2e128565b', 'a3ac5a44-f5c5-4313-b63f-eb4124573f4a', 'f3e78e46-3685-4540-8ec9-77221316ce65'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:42 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:42 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:42 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e 1G" returned: 0 in 0.783s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:42 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e Nov 04 22:23:42 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:42 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.288s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Deleted volume successfully. Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a794e868-5ba6-49bf-801e-18ae68015edd tempest-VolumesCloneTest-979369376 None] Lock "cinder-6cddb7b8-7ab4-4cc0-b24d-851fa8401c00-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:42 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" returned: 0 in 0.357s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:42 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:42 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e Nov 04 22:23:42 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:42 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:42 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info Nov 04 22:23:42 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:43 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info" returned: 0 in 0.301s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:43 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:43 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info Nov 04 22:23:43 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:43 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.info" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.115s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58e027d0-5461-4fa3-815f-ec4e25554e88,created_at=2026-11-04T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025834071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58e027d0-5461-4fa3-815f-ec4e25554e88,host='devstack@QuobyteHD#QuobyteHD',id=1b0c93fc-f0ba-40e4-9abe-68b132318886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:37Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38d37afa-79af-4ccc-880c-afda84fcdab6),volume_type_id=38d37afa-79af-4ccc-880c-afda84fcdab6)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Creating volume 1b0c93fc-f0ba-40e4-9abe-68b132318886 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:43 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:43 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 1073741824 Nov 04 22:23:43 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c530b518-f47e-47cf-b506-5efb9b6b1ce6 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: created successfully Nov 04 22:23:44 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 1073741824" returned: 0 in 0.595s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:44 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 Nov 04 22:23:44 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:44 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886" returned: 0 in 0.301s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3610f1-a7c6-421e-996a-fe3aba01c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0c93fc-f0ba-40e4-9abe-68b132318886', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d937081-c529-4e65-933a-2d99e2ddb3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Volume volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 (1b0c93fc-f0ba-40e4-9abe-68b132318886): created successfully Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d937081-c529-4e65-933a-2d99e2ddb3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (4e67d914-1fc3-4333-9412-fe534ad67687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-16ce5834-aa67-4527-afdd-b50f2ed33fa9 tempest-GroupsTest-1336917547 None] Created volume successfully. Nov 04 22:23:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: deleting Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: deleting {{(pid=87173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Deleting offline snapshot 0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 of volume aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] snapshot_file for this snap is: volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b9d57f-9ab4-404b-95a0-fffe625ff112]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:45 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 Nov 04 22:23:45 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:45 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" returned: 0 in 0.457s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa849e8d-956e-43f2-96d3-72502c01cd80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ac04e-a826-479f-b9e8-f9179fd23d7d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:45 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 Nov 04 22:23:45 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:45 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80" returned: 0 in 0.437s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:45 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 Nov 04 22:23:45 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:46 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:46 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2 Nov 04 22:23:46 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:46 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80.0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-0337fe1f-6875-4b8e-8dbd-abeb9a7c95b2" released by "_delete_snapshot" :: held 1.793s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" released by "delete_snapshot" :: held 1.820s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Deleting offline snapshot c3c07c9d-d61d-4bc5-a70b-fc9770545b6e of volume 9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] snapshot_file for this snap is: volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d0bd1-aca9-443b-b711-7f5422ffab3f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:46 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e Nov 04 22:23:46 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:47 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" returned: 0 in 0.409s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb9a73-354b-4639-a694-edc1a9452b22]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:47 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 Nov 04 22:23:47 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Acquiring lock "cinder-quobyte-1b0c93fc-f0ba-40e4-9abe-68b132318886" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-1b0c93fc-f0ba-40e4-9abe-68b132318886" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be3923-a46e-4e33-9e0d-7fe37d8979d8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:47 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846" returned: 0 in 0.507s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:47 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e Nov 04 22:23:47 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:47 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 Nov 04 22:23:47 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Flow 'volume_create_manager' (8856f4e1-e90f-4e20-9aea-c4ea68059eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a98d5e-825d-4fd4-a8c4-8c0eb4606256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a98d5e-825d-4fd4-a8c4-8c0eb4606256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2105226361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f298b44-0faf-45d8-acb1-5855a3867f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3e11a48f3b4edd817bf6ba4581f95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:48Z,use_quota=True,user_id='73f8f09a65934a55a8b3720d052abb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e32469-c920-4a9d-8f07-37d802c79cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e32469-c920-4a9d-8f07-37d802c79cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858593e0-2c8d-4dfc-a08e-c7bba7eda6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858593e0-2c8d-4dfc-a08e-c7bba7eda6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f298b44-0faf-45d8-acb1-5855a3867f8a', 'volume_name': 'volume-6f298b44-0faf-45d8-acb1-5855a3867f8a', 'volume_size': 2}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c923b8-054c-4a05-87a3-a05c54529616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c923b8-054c-4a05-87a3-a05c54529616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea84eb4-16f0-4271-9f17-c9119a73bc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Volume 6f298b44-0faf-45d8-acb1-5855a3867f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f298b44-0faf-45d8-acb1-5855a3867f8a', 'volume_size': 2} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2105226361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f298b44-0faf-45d8-acb1-5855a3867f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3e11a48f3b4edd817bf6ba4581f95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:48Z,use_quota=True,user_id='73f8f09a65934a55a8b3720d052abb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Creating volume 6f298b44-0faf-45d8-acb1-5855a3867f8a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:47 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a 2147483648 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:48 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a 2147483648 Nov 04 22:23:48 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Flow 'volume_create_manager' (58a3a71b-eff0-4bb5-8841-0faeaf1dd664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639c882d-b9e9-4af7-b7f5-d92017e21f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639c882d-b9e9-4af7-b7f5-d92017e21f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-234996676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c179d9-10c5-4d06-97a0-c16ed2efd27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0120772840d4e9e9068cf855b2805f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:48Z,use_quota=True,user_id='19f7e7a951564d7293b30493984171f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79690f54-ea85-4545-a528-fd61f35d6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79690f54-ea85-4545-a528-fd61f35d6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77934dca-3a08-49b5-96e4-35c8be351193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:23:48 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:48 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886 Nov 04 22:23:48 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:48 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:48 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e Nov 04 22:23:48 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:48 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1b0c93fc-f0ba-40e4-9abe-68b132318886" returned: 0 in 0.303s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-1b0c93fc-f0ba-40e4-9abe-68b132318886" released by "delete_volume" :: held 0.830s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:48 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846.c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:48 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a 2147483648" returned: 0 in 0.617s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-c3c07c9d-d61d-4bc5-a70b-fc9770545b6e" released by "_delete_snapshot" :: held 1.812s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" released by "delete_snapshot" :: held 1.855s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77934dca-3a08-49b5-96e4-35c8be351193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'volume_name': 'volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef689f58-953a-4126-9dfd-0f92da33a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef689f58-953a-4126-9dfd-0f92da33a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa633cdf-f8d2-4a62-a931-c33b1b81e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Trying to clone 56c179d9-10c5-4d06-97a0-c16ed2efd27e from image 728a9578-311c-407d-85c9-cd39797548f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Created reservations ['5ae20414-917f-47c9-bc44-67256a9db34f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:48 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a Nov 04 22:23:48 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:48 devstack cinder-volume[87173]: WARNING cinder.quota [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1341398533 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1341398533, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:48 devstack cinder-volume[87173]: WARNING cinder.quota [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1341398533 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1341398533, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Created reservations ['b99cdef6-b037-4e13-bc12-91db4f02ba78', '3757f5b8-6bc8-4959-97cd-9eb7160cb750', '7db13526-ce51-466f-a772-94f73c5550c2', 'f98c7be7-5e71-4cad-8ea7-375bc3c1d931'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:48 devstack cinder-volume[87173]: WARNING cinder.quota [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-511159271 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-511159271, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:48 devstack cinder-volume[87173]: WARNING cinder.quota [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-511159271 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-511159271, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['b4bd6e99-e451-47e6-805e-02fb0c655452', '5cac9fd8-33d5-4007-a503-6b6bc7527a34', '1f7475eb-8de9-4cfb-b0c6-fc3d5da2d8dd', '4547582a-c298-435b-83fc-d8294e427e9f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:49 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea84eb4-16f0-4271-9f17-c9119a73bc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f298b44-0faf-45d8-acb1-5855a3867f8a', 'volume_size': 2}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f4d79-47aa-470f-8ce9-19218d2f290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Volume volume-6f298b44-0faf-45d8-acb1-5855a3867f8a (6f298b44-0faf-45d8-acb1-5855a3867f8a): created successfully Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f4d79-47aa-470f-8ce9-19218d2f290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Flow 'volume_create_manager' (8856f4e1-e90f-4e20-9aea-c4ea68059eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9fe7b9be-eefe-4ce8-8796-05342573b860 tempest-VolumesCloneNegativeTest-1764742224 None] Created volume successfully. Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:23:49 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Image download 20.69 MB at 20.69 MB/s Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5d380-724e-4cd1-9047-d4a501386978]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:49 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:49 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['d416f440-6e88-46e4-88e2-f004a140a0e8', '4e44d856-e5a8-48f4-aba7-d6060fb9cd68', 'c9de590c-1c90-47f6-99e4-e78ebeef9014', 'b13cfff9-0655-408d-a256-a119f83cb31d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-575d079f-6fba-4ffd-a764-2d08600259c3 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot c1b20cca-cc80-4005-b693-bb367fe53ad6: deleted successfully Nov 04 22:23:49 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD Nov 04 22:23:49 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:49 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6e0ec873-1480-414a-a8ea-02d14a85154a tempest-GroupsTest-1336917547 None] Delete group completed successfully. Nov 04 22:23:49 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 is fetched for user 19f7e7a951564d7293b30493984171f3. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f0b02-b72e-4505-951c-c51fac026b3f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:49 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD Nov 04 22:23:49 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:50 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-234996676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c179d9-10c5-4d06-97a0-c16ed2efd27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0120772840d4e9e9068cf855b2805f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:48Z,use_quota=True,user_id='19f7e7a951564d7293b30493984171f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Creating volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:50 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33270a2-1df2-4e04-8fb0-e90e77400ae4]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1073741824 Nov 04 22:23:50 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 Nov 04 22:23:50 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Acquiring lock "cinder-6f298b44-0faf-45d8-acb1-5855a3867f8a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "cinder-6f298b44-0faf-45d8-acb1-5855a3867f8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Acquiring lock "cinder-quobyte-6f298b44-0faf-45d8-acb1-5855a3867f8a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Created reservations ['03486325-e6c4-4da9-a7ac-2ddad58b966a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "cinder-quobyte-6f298b44-0faf-45d8-acb1-5855a3867f8a" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee18ea7-e19a-4311-8c73-c909d0df096e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:50 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a Nov 04 22:23:50 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846" returned: 0 in 0.481s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846 Nov 04 22:23:50 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1073741824" returned: 0 in 0.604s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e Nov 04 22:23:50 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:50 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-412ee323-6a32-4095-9b73-54e64cc7f455 tempest-GroupsTest-1336917547 None] Delete group completed successfully. Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a" returned: 0 in 0.423s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:50 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a Nov 04 22:23:50 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:50 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e4eefe3-ebfe-465e-be81-8af7d9f42846" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-9e4eefe3-ebfe-465e-be81-8af7d9f42846" released by "delete_volume" :: held 0.891s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" acquired by "delete_volume" :: waited 0.012s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba4a5c0-55ac-438a-b56a-4b7bc9fc3e32]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:51 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Attempting download of 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:23:51 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 Nov 04 22:23:51 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:51 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6f298b44-0faf-45d8-acb1-5855a3867f8a" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa39ea9-77ba-4620-9c8e-f2c6e3d1fe36]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "cinder-quobyte-6f298b44-0faf-45d8-acb1-5855a3867f8a" released by "delete_volume" :: held 0.776s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Created reservations ['316889a0-acf2-4bbd-84c9-aabf0e307407', '4a674140-47f5-4b25-b790-f3210661f7c6', 'e4d85b35-393f-49f0-917d-161da78acd29', '4f517922-3cdd-4650-a896-1c3429a3353c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:51 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq Nov 04 22:23:51 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:51 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:51 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:51 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80" returned: 0 in 0.487s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:51 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80 Nov 04 22:23:51 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:51 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq" returned: 0 in 0.500s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:51 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.328s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Deleted volume successfully. Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-307d5750-c270-4772-95fa-3ecef1cd08d6 tempest-VolumesCloneNegativeTest-1764742224 None] Lock "cinder-6f298b44-0faf-45d8-acb1-5855a3867f8a-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:51 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq Nov 04 22:23:51 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:51 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-aa849e8d-956e-43f2-96d3-72502c01cd80" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-aa849e8d-956e-43f2-96d3-72502c01cd80" released by "delete_volume" :: held 0.936s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['9f409407-6e38-44d5-858c-795df750b7c7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:52 devstack cinder-volume[87173]: WARNING cinder.quota [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-511159271 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-511159271, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:23:52 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq" returned: 1 in 0.411s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_cyhj6svq' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5049a2-7f38-475c-ac9e-9d739d047e73]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['8a7ca1e5-5285-480c-b2f2-ad63c43b5cb6', '89cfeb0c-1e78-4b8c-a62c-a571eb409460', '6bfc17e9-3793-47bc-9a98-85fe77c9cf80', '812f115c-5e58-4e54-913e-43da172e6235'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:52 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD Nov 04 22:23:52 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-85158567-4232-4788-9994-bbbcda32c22e tempest-GroupsTest-1336917547 None] Group tempest-GroupsTest-Group-1880160469: creating Nov 04 22:23:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-85158567-4232-4788-9994-bbbcda32c22e tempest-GroupsTest-1336917547 None] Group tempest-GroupsTest-Group-1880160469: created successfully Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['83396d7a-36bf-4dd5-8096-ad14c5a814ed', '176da1ca-4136-4e3c-8815-2f7583536734', '70b18302-aff1-41f5-a54e-b8fdf17bcc29', '95abc277-a383-4e10-b728-1efe6fb7d8e9'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:23:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-85158567-4232-4788-9994-bbbcda32c22e tempest-GroupsTest-1336917547 None] Create group completed successfully. Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:52 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:52 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:52 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] 728a9578-311c-407d-85c9-cd39797548f0 was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:52 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e Nov 04 22:23:52 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:52 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.287s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:52 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a6c11bbc-76ae-48da-9831-605eb429d809 tempest-GroupSnapshotsTest-1953372399 None] Delete group completed successfully. Nov 04 22:23:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9691f898-24fb-4fa5-994e-c062c9ce62d1 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-1367261650: creating Nov 04 22:23:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9691f898-24fb-4fa5-994e-c062c9ce62d1 tempest-GroupSnapshotsTest-1953372399 None] Group tempest-GroupSnapshotsTest-Group-1367261650: created successfully Nov 04 22:23:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9691f898-24fb-4fa5-994e-c062c9ce62d1 tempest-GroupSnapshotsTest-1953372399 None] Create group completed successfully. Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (b16dda28-3289-4c23-955f-df32c5e4185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2e63a5-bf08-43c9-9518-5d6effc9bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2e63a5-bf08-43c9-9518-5d6effc9bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-642080228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94c9a91a-3617-4faf-be20-a961d6390a40,host='devstack@QuobyteHD#QuobyteHD',id=3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:54Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88fc3f2e-366f-4d68-88f5-5a02753dc422),volume_type_id=88fc3f2e-366f-4d68-88f5-5a02753dc422)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37472c1d-1c6d-4bcc-8698-97f57d46b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37472c1d-1c6d-4bcc-8698-97f57d46b21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af8ba27-7edf-46b7-b1b8-a8e7821d2ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af8ba27-7edf-46b7-b1b8-a8e7821d2ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9', 'volume_name': 'volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35b1221-8dd9-4139-8ece-d016403937c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35b1221-8dd9-4139-8ece-d016403937c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defa1289-dff2-43c2-9092-c56131855e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Volume 3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9', 'volume_size': 1} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94c9a91a-3617-4faf-be20-a961d6390a40,created_at=2026-11-04T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-642080228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94c9a91a-3617-4faf-be20-a961d6390a40,host='devstack@QuobyteHD#QuobyteHD',id=3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:54Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88fc3f2e-366f-4d68-88f5-5a02753dc422),volume_type_id=88fc3f2e-366f-4d68-88f5-5a02753dc422)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Creating volume 3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:54 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:54 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 1073741824 Nov 04 22:23:54 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:54 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 1073741824" returned: 0 in 0.631s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:54 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e" returned: 0 in 2.477s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_g9ywoes_devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:23:54 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Converted 112.00 MB image at 45.20 MB/s Nov 04 22:23:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:55 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1G Nov 04 22:23:55 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:55 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 Nov 04 22:23:55 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (1a68faca-6799-4367-af55-1797f40ec563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4497f0c4-49cd-427e-811b-9e8c5cf9056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4497f0c4-49cd-427e-811b-9e8c5cf9056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095608894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af095e77-e84e-427c-9e11-ad543e254656,host='devstack@QuobyteHD#QuobyteHD',id=36b2f762-4f3d-4240-bd20-25d1a2ae1c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:55Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304385f6-c2f1-432c-b4f7-01e1c345171b),volume_type_id=304385f6-c2f1-432c-b4f7-01e1c345171b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8174c096-5e9b-48a0-911b-7ccee0db876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8174c096-5e9b-48a0-911b-7ccee0db876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeed14c7-d0ea-4f2e-a538-c3e552ad89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeed14c7-d0ea-4f2e-a538-c3e552ad89a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b2f762-4f3d-4240-bd20-25d1a2ae1c06', 'volume_name': 'volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa571fb9-2905-417b-9f51-d6c287826250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa571fb9-2905-417b-9f51-d6c287826250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f111f-d567-4935-b1d9-7f8357a49e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Volume 36b2f762-4f3d-4240-bd20-25d1a2ae1c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06', 'volume_size': 1} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:55 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af095e77-e84e-427c-9e11-ad543e254656,created_at=2026-11-04T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095608894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af095e77-e84e-427c-9e11-ad543e254656,host='devstack@QuobyteHD#QuobyteHD',id=36b2f762-4f3d-4240-bd20-25d1a2ae1c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a117320c5422d948dd2184bf0825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:55Z,use_quota=True,user_id='c774b0265de744e5804153293cab83c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304385f6-c2f1-432c-b4f7-01e1c345171b),volume_type_id=304385f6-c2f1-432c-b4f7-01e1c345171b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Creating volume 36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:55 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defa1289-dff2-43c2-9092-c56131855e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274af166-98ea-4b72-aa5b-2490cc589088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 1073741824 Nov 04 22:23:55 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e 1G" returned: 0 in 0.466s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Downloaded image 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 for user 19f7e7a951564d7293b30493984171f3 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Marking volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Volume volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 (3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9): created successfully Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274af166-98ea-4b72-aa5b-2490cc589088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (b16dda28-3289-4c23-955f-df32c5e4185e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Copying metadata from image 728a9578-311c-407d-85c9-cd39797548f0 to 56c179d9-10c5-4d06-97a0-c16ed2efd27e. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Creating volume glance metadata for volume 56c179d9-10c5-4d06-97a0-c16ed2efd27e backed by image 728a9578-311c-407d-85c9-cd39797548f0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4fe03334-5014-4d9b-9eb6-cc69ab30725c tempest-GroupsTest-1336917547 None] Created volume successfully. Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa633cdf-f8d2-4a62-a931-c33b1b81e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9b212d-9ab2-4101-97fb-2374d8282b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Volume volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e (56c179d9-10c5-4d06-97a0-c16ed2efd27e): created successfully Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9b212d-9ab2-4101-97fb-2374d8282b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Flow 'volume_create_manager' (58a3a71b-eff0-4bb5-8841-0faeaf1dd664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-00d5d91b-ce49-4c8d-9dd1-31e52e5451f1 tempest-ServerActionsTestOtherA-2018913913 None] Created volume successfully. Nov 04 22:23:55 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 1073741824" returned: 0 in 0.459s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:55 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 Nov 04 22:23:55 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:56 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" returned: 0 in 0.252s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f111f-d567-4935-b1d9-7f8357a49e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422656e6-2178-4421-a04a-1f91f2e1a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Volume volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 (36b2f762-4f3d-4240-bd20-25d1a2ae1c06): created successfully Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422656e6-2178-4421-a04a-1f91f2e1a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Flow 'volume_create_manager' (1a68faca-6799-4367-af55-1797f40ec563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-05308619-2a92-46b2-8f74-9cb3632a7d9f tempest-GroupSnapshotsTest-1953372399 None] Created volume successfully. Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Flow 'volume_create_manager' (a7b8726f-3587-4d52-afd9-b71875876b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abef2457-2ffb-4502-b876-afbb3dcc8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abef2457-2ffb-4502-b876-afbb3dcc8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-722356868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f0af7cefff44939ab96cbfb3a4574e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:56Z,use_quota=True,user_id='283e404912ae4a53868d756a0a2c41c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33331951-3fbf-4bb0-b012-aa393dbc8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33331951-3fbf-4bb0-b012-aa393dbc8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fcbf29-21ea-4b07-aa6b-e8223f11b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:56 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:23:56 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fcbf29-21ea-4b07-aa6b-e8223f11b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7', 'volume_name': 'volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836cabd4-7b59-41ac-a036-9699e0be3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836cabd4-7b59-41ac-a036-9699e0be3257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb6fbbe-a042-42b3-835c-889f88672de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Trying to clone b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 from image 728a9578-311c-407d-85c9-cd39797548f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:23:56 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:23:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (116128d6-97dd-427b-81dc-ee8655db21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6b41c0-e2d5-481a-be2d-ec53582bc42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6b41c0-e2d5-481a-be2d-ec53582bc42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2065150738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94c9a91a-3617-4faf-be20-a961d6390a40,host='devstack@QuobyteHD#QuobyteHD',id=2ce83827-7f85-4bc9-a9ba-a34b3b152e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:57Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88fc3f2e-366f-4d68-88f5-5a02753dc422),volume_type_id=88fc3f2e-366f-4d68-88f5-5a02753dc422)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7af5f6-9723-4c64-8524-ef38af4ddd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7af5f6-9723-4c64-8524-ef38af4ddd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5bb975-a26a-488c-a25a-5ae3d0b4f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5bb975-a26a-488c-a25a-5ae3d0b4f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce83827-7f85-4bc9-a9ba-a34b3b152e75', 'volume_name': 'volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fd7d5d-4bda-4702-8ce2-11880ecca147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fd7d5d-4bda-4702-8ce2-11880ecca147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8848ca-b1d1-4466-bfad-84cda2457e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:57 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Volume 2ce83827-7f85-4bc9-a9ba-a34b3b152e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75', 'volume_size': 1} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94c9a91a-3617-4faf-be20-a961d6390a40,created_at=2026-11-04T21:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2065150738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94c9a91a-3617-4faf-be20-a961d6390a40,host='devstack@QuobyteHD#QuobyteHD',id=2ce83827-7f85-4bc9-a9ba-a34b3b152e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fef6ab5ae4bf8ba1a01048f241db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:57Z,use_quota=True,user_id='236cc12299a64994b3284ae7195091d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88fc3f2e-366f-4d68-88f5-5a02753dc422),volume_type_id=88fc3f2e-366f-4d68-88f5-5a02753dc422)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Creating volume 2ce83827-7f85-4bc9-a9ba-a34b3b152e75 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:23:57 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:23:57 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Image download 20.69 MB at 20.69 MB/s Nov 04 22:23:57 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 1073741824 Nov 04 22:23:57 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeb851c-59e9-42db-b195-e2c4b5f01e29]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:57 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD Nov 04 22:23:57 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] GroupSnapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: creating. Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Group snapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: creating. {{(pid=87173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 22:23:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:58 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 is fetched for user 283e404912ae4a53868d756a0a2c41c2. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f09fba-acc2-46f4-8a75-00a961b2c347]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:58 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 1073741824" returned: 0 in 0.611s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:58 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 Nov 04 22:23:58 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:58 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD Nov 04 22:23:58 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:58 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" returned: 0 in 0.265s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.581s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8848ca-b1d1-4466-bfad-84cda2457e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6ae814-a5bb-4c5e-996e-7b14b6d304d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:23:58 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Creating offline snapshot 65a2ced0-8f89-40b6-ab4c-5b505739f318 of volume 36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:58 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Volume volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 (2ce83827-7f85-4bc9-a9ba-a34b3b152e75): created successfully Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6ae814-a5bb-4c5e-996e-7b14b6d304d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Flow 'volume_create_manager' (116128d6-97dd-427b-81dc-ee8655db21ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2327488-b2d4-425c-a375-707956a5fa0f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1e3827f1-a1b2-48d7-8662-bb0c15cca071 tempest-GroupsTest-1336917547 None] Created volume successfully. Nov 04 22:23:58 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 Nov 04 22:23:58 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:58 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:58 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 1G Nov 04 22:23:58 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:59 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 1G" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:59 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 Nov 04 22:23:59 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:59 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Nov 04 22:23:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:23:59 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:23:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:23:59 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 Nov 04 22:23:59 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:23:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-e93649bf-9667-4eee-9324-06cf7532e0e2 req-cf87394b-89c3-41cc-afc6-190b1eb884f7 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:23:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c2305883-8f6d-475c-ab2d-848a0cbd0eb9 tempest-GroupsTest-1336917547 None] Update group completed successfully. Nov 04 22:24:00 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318" returned: 0 in 0.300s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:00 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info Nov 04 22:24:00 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:00 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:00 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:00 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info Nov 04 22:24:00 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:00 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.info" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-722356868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f0af7cefff44939ab96cbfb3a4574e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:23:56Z,use_quota=True,user_id='283e404912ae4a53868d756a0a2c41c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Creating volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:00 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:00 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1073741824 Nov 04 22:24:00 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9bc120be-fea5-4a8e-9c4b-bb57b1aef263 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: created successfully Nov 04 22:24:01 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1073741824" returned: 0 in 0.558s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:01 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 Nov 04 22:24:01 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5fba1404-7116-4496-9f65-82820f250138 tempest-GroupsTest-1336917547 None] Update group completed successfully. Nov 04 22:24:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: deleting Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: deleting {{(pid=87173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-65a2ced0-8f89-40b6-ab4c-5b505739f318" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-65a2ced0-8f89-40b6-ab4c-5b505739f318" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:01 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Deleting offline snapshot 65a2ced0-8f89-40b6-ab4c-5b505739f318 of volume 36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] snapshot_file for this snap is: volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" returned: 0 in 0.464s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-e93649bf-9667-4eee-9324-06cf7532e0e2 req-cf87394b-89c3-41cc-afc6-190b1eb884f7 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.949s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[de744080-ec5d-406f-9b15-52c05275e069]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Attempting download of 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-e93649bf-9667-4eee-9324-06cf7532e0e2 req-cf87394b-89c3-41cc-afc6-190b1eb884f7 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-e93649bf-9667-4eee-9324-06cf7532e0e2 req-cf87394b-89c3-41cc-afc6-190b1eb884f7 tempest-ServerActionsTestOtherA-2018913913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '639ec3a5-a048-4233-9c71-243fa78460bb', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eeeb5f-36e2-46d7-b355-55eb72919e71]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:01 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 Nov 04 22:24:01 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:02 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-e93649bf-9667-4eee-9324-06cf7532e0e2 req-cf87394b-89c3-41cc-afc6-190b1eb884f7 tempest-ServerActionsTestOtherA-2018913913 None] attachment_update completed successfully. Nov 04 22:24:02 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m Nov 04 22:24:02 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:02 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2883a4c-95b5-4537-9911-a3dbd8faeb23]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:02 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m" returned: 0 in 0.497s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:02 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 Nov 04 22:24:02 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:02 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m Nov 04 22:24:02 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:02 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:02 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 Nov 04 22:24:02 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:02 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m" returned: 1 in 0.500s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6yhq_48m' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac67c5-a6b6-4c1b-a295-2d6f0652de9b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:03 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD Nov 04 22:24:03 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:03 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318" returned: 0 in 0.708s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:03 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] 728a9578-311c-407d-85c9-cd39797548f0 was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:03 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318 Nov 04 22:24:03 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:03 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 Nov 04 22:24:03 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Acquiring lock "cinder-quobyte-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[96021d8d-5e8b-435e-a7ca-772fe7bdce1d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:04 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06.65a2ced0-8f89-40b6-ab4c-5b505739f318" returned: 0 in 0.599s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:04 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 Nov 04 22:24:04 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-65a2ced0-8f89-40b6-ab4c-5b505739f318" released by "_delete_snapshot" :: held 2.470s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" released by "delete_snapshot" :: held 2.517s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:04 devstack cinder-volume[87173]: WARNING cinder.quota [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-276811186 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-276811186, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:04 devstack cinder-volume[87173]: WARNING cinder.quota [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-276811186 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-276811186, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['94deed0b-2be9-4b6c-b716-6bf0d151c9b5', '8d5f1aa8-e623-4bb0-bfbf-666e4a5579cc', 'c8421a29-c6a9-43f2-b0f7-81f490931eb7', '4be8eb57-49c7-48e6-8624-4c3ce29fa64c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f02b297d-5b9e-43dd-b487-7c2d6377b8c4 tempest-GroupSnapshotsTest-1953372399 None] group_snapshot 7596b229-a8bc-4b3e-9506-c39239d22e4e: deleted successfully Nov 04 22:24:04 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" returned: 0 in 0.688s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:04 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75 Nov 04 22:24:04 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:04 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-2ce83827-7f85-4bc9-a9ba-a34b3b152e75" released by "delete_volume" :: held 1.070s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Acquiring lock "cinder-quobyte-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566d17b-aec8-4850-bc0b-8cf814109f2e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:05 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 Nov 04 22:24:05 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:05 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" returned: 0 in 0.639s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:05 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9 Nov 04 22:24:05 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7b81b-e011-406f-ab38-30be0f758dd3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:06 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 Nov 04 22:24:06 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:06 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" returned: 0 in 0.549s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "cinder-quobyte-3c7d9cd4-3102-4ed6-92a4-ff6935aa4eb9" released by "delete_volume" :: held 1.277s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Created reservations ['71f89653-af6e-4d4a-a627-ca4f33740d24'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:06 devstack cinder-volume[87173]: WARNING cinder.quota [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-86717675 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-86717675, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:06 devstack cinder-volume[87173]: WARNING cinder.quota [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-86717675 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-86717675, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Created reservations ['ddf69cbd-094e-4dfb-8a62-d2720938dd45', '27d97ac4-964a-414a-bc4a-8d1bdd73fc6f', 'b45d64a7-eb77-401c-8094-3654da53067a', 'e4d17d0b-e3e1-470c-9e1b-cc6fbe942324'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Created reservations ['5fa3d63c-572e-487d-8b7a-e472eb1e028f', '80503bc8-260f-4465-b35a-6436c1c7e1cd', 'a1ad3dd5-c8d7-4c16-8271-08d21a177808', 'd73a5e45-955c-49e4-91f0-0f17367c5967'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:06 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" returned: 0 in 3.167s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_skrkuf1udevstack@QuobyteHD, size 112.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:24:06 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Converted 112.00 MB image at 35.35 MB/s Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:06 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" returned: 0 in 0.875s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1G Nov 04 22:24:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:06 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06 Nov 04 22:24:06 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:07 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:07 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:07 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" returned: 0 in 0.498s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Lock "cinder-quobyte-36b2f762-4f3d-4240-bd20-25d1a2ae1c06" released by "delete_volume" :: held 1.503s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:07 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 1G" returned: 0 in 0.699s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Downloaded image 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 for user 283e404912ae4a53868d756a0a2c41c2 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Marking volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Copying metadata from image 728a9578-311c-407d-85c9-cd39797548f0 to b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Creating volume glance metadata for volume b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 backed by image 728a9578-311c-407d-85c9-cd39797548f0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['52fd8bab-a461-402d-aea9-0f99857f6daf'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:07 devstack cinder-volume[87173]: WARNING cinder.quota [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-276811186 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-276811186, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Created reservations ['9d1e378f-e4c7-4448-9914-1c99ca6beffc', '84586780-7b56-42b5-ba6c-8cbdefdfa289', '19112b04-c588-47fb-b146-ef1ef15d3c9a', '095eced6-3de7-4b9f-86da-f6493e7dc979'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:07 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.632s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4d0fb765-200c-4392-886d-540c42657293 tempest-GroupsTest-1336917547 None] Delete group completed successfully. Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb6fbbe-a042-42b3-835c-889f88672de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debb086e-8643-4240-8ae2-f4753f04b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Volume volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 (b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7): created successfully Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debb086e-8643-4240-8ae2-f4753f04b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Flow 'volume_create_manager' (a7b8726f-3587-4d52-afd9-b71875876b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b98cdefd-51fb-4d50-8d16-ce079c309be8 tempest-VolumesExtendTest-337480290 None] Created volume successfully. Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:07 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:07 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:08 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4032f822-63a0-49ee-9994-de684ad78c64 tempest-GroupSnapshotsTest-1953372399 None] Delete group completed successfully. Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37963b-2438-4708-9cff-3eee6b8bc8b1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:09 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 Nov 04 22:24:09 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:09 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" returned: 0 in 0.770s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 2G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 2G" returned: 0 in 0.219s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.043s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dfd69919-4c3d-4dec-ae72-921b21dbe08c tempest-VolumesExtendTest-337480290 None] Extend volume completed successfully. Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "cinder-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-quobyte-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd20bb-f2cb-4345-b6db-d2c7b8c4c0e8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:11 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 Nov 04 22:24:11 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:12 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" returned: 0 in 0.858s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:12 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7 Nov 04 22:24:12 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:12 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7" released by "delete_volume" :: held 1.388s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Created reservations ['cdfbfd97-7741-439f-8816-c2bbd3d92c73', '799c5e38-6686-4af8-9809-492bdbfb8216', 'd669ad3d-3fff-4b58-be78-63d05e4ff32c', 'a7526819-c0f9-4f1d-8075-8cdadd7d1e39'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:12 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:12 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:13 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Deleted volume successfully. Nov 04 22:24:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e151e1f-8d87-4138-84bd-db70c77dca3b tempest-VolumesExtendTest-337480290 None] Lock "cinder-b7ff6a1e-c76a-44fe-8d47-9e5f00e9d8c7-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Flow 'volume_create_manager' (4d7a955d-8fc1-42cd-aa1d-fb309cda1ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6106e60f-1602-4bcc-9fe3-2cd5c8b60f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6106e60f-1602-4bcc-9fe3-2cd5c8b60f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-115201854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4863927-fca5-4d3e-9234-91eef08c9974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f0af7cefff44939ab96cbfb3a4574e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:14Z,use_quota=True,user_id='283e404912ae4a53868d756a0a2c41c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df872051-cb9a-46a8-bdbe-112ff7d12b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df872051-cb9a-46a8-bdbe-112ff7d12b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72d7614-4023-437a-9954-d30d34e7e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72d7614-4023-437a-9954-d30d34e7e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4863927-fca5-4d3e-9234-91eef08c9974', 'volume_name': 'volume-d4863927-fca5-4d3e-9234-91eef08c9974', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79018344-f099-41a4-8b60-df431b362874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79018344-f099-41a4-8b60-df431b362874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfcf7bc-82b6-43cc-a948-c35b909986a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Volume d4863927-fca5-4d3e-9234-91eef08c9974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4863927-fca5-4d3e-9234-91eef08c9974', 'volume_size': 1} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-115201854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4863927-fca5-4d3e-9234-91eef08c9974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f0af7cefff44939ab96cbfb3a4574e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:14Z,use_quota=True,user_id='283e404912ae4a53868d756a0a2c41c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Creating volume d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:14 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:14 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 1073741824 Nov 04 22:24:14 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:15 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 1073741824" returned: 0 in 0.680s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=172,cinder:UPDATE=170,cinder:INSERT=45,cinder:DELETE=11 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=191,cinder:SELECT=185,cinder:INSERT=59,cinder:DELETE=4 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:15 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:15 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:15 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfcf7bc-82b6-43cc-a948-c35b909986a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4863927-fca5-4d3e-9234-91eef08c9974', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fe09a1-dac2-43e7-a27b-64ade1878197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Volume volume-d4863927-fca5-4d3e-9234-91eef08c9974 (d4863927-fca5-4d3e-9234-91eef08c9974): created successfully Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fe09a1-dac2-43e7-a27b-64ade1878197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Flow 'volume_create_manager' (4d7a955d-8fc1-42cd-aa1d-fb309cda1ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0e53301e-bdc8-45e5-bf12-7658beb6e544 tempest-VolumesExtendTest-337480290 None] Created volume successfully. Nov 04 22:24:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Creating offline snapshot dbc596a5-dd74-49f7-8d69-5fa0b75d4419 of volume d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:24:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f47f69-e358-4cd4-91bb-ae5cee741a70]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:17 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:17 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:17 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.904s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:18 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 1G Nov 04 22:24:18 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:18 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 1G" returned: 0 in 0.708s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4863927-fca5-4d3e-9234-91eef08c9974 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:18 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4863927-fca5-4d3e-9234-91eef08c9974 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 Nov 04 22:24:18 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:19 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4863927-fca5-4d3e-9234-91eef08c9974 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419" returned: 0 in 0.523s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:19 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 is being set with open permissions: ugo+rw Nov 04 22:24:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:19 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 Nov 04 22:24:19 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:19 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419" returned: 0 in 0.404s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8773350c-a15d-4cdc-9648-9fe3b37c38c7 tempest-GroupsV314Test-886008324 None] Group tempest-GroupsV314Test-Group-1798272017: creating Nov 04 22:24:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8773350c-a15d-4cdc-9648-9fe3b37c38c7 tempest-GroupsV314Test-886008324 None] Group tempest-GroupsV314Test-Group-1798272017: created successfully Nov 04 22:24:19 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info Nov 04 22:24:19 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8773350c-a15d-4cdc-9648-9fe3b37c38c7 tempest-GroupsV314Test-886008324 None] Create group completed successfully. Nov 04 22:24:20 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:20 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info is being set with open permissions: ugo+rw Nov 04 22:24:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:20 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info Nov 04 22:24:20 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-936e7f6f-1104-42bb-baba-637a548a267d tempest-ServerActionsTestOtherA-2018913913 None] Terminate volume connection completed successfully. Nov 04 22:24:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-936e7f6f-1104-42bb-baba-637a548a267d tempest-ServerActionsTestOtherA-2018913913 None] Deleting attachment 639ec3a5-a048-4233-9c71-243fa78460bb. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:24:20 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.info" returned: 0 in 0.290s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.474s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5426929b-ec3f-42fc-b03b-2aac12857db3 tempest-VolumesExtendTest-337480290 None] Create snapshot completed successfully Nov 04 22:24:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-73b13a27-2506-4d17-8c1e-f2727d5ea64a tempest-GroupSnapshotsV319Test-1051138785 None] Group tempest-GroupSnapshotsV319Test-Group-1704535420: creating Nov 04 22:24:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-73b13a27-2506-4d17-8c1e-f2727d5ea64a tempest-GroupSnapshotsV319Test-1051138785 None] Group tempest-GroupSnapshotsV319Test-Group-1704535420: created successfully Nov 04 22:24:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-73b13a27-2506-4d17-8c1e-f2727d5ea64a tempest-GroupSnapshotsV319Test-1051138785 None] Create group completed successfully. Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03ec88-7cb1-4c7a-b677-f832ec53f399]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Flow 'volume_create_manager' (9c615801-2fc8-435f-8f52-3ba846372f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a09421-9143-4099-bba7-eebf4b5a8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a09421-9143-4099-bba7-eebf4b5a8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014398615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be8e269-8d62-42b3-ad2e-60daf26439bf,host='devstack@QuobyteHD#QuobyteHD',id=8fb7364c-f59a-4317-9a48-0f2f9e1a2825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536c5a4e49f047868d327a7a83eb5e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:21Z,use_quota=True,user_id='717a23874acb464e8b00b3a1448745ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afefc188-4a37-4c9a-8cc9-ac2a859495f6),volume_type_id=afefc188-4a37-4c9a-8cc9-ac2a859495f6)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057c896-261e-45f0-8560-9805f03e8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057c896-261e-45f0-8560-9805f03e8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:21 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:21 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438bbca4-1c5f-48c7-8261-112ed7dd53a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438bbca4-1c5f-48c7-8261-112ed7dd53a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb7364c-f59a-4317-9a48-0f2f9e1a2825', 'volume_name': 'volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec7cc1-22d8-4612-a206-4204774660e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec7cc1-22d8-4612-a206-4204774660e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f5c3e1-65d0-4b49-8781-99d5d5676e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Volume 8fb7364c-f59a-4317-9a48-0f2f9e1a2825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825', 'volume_size': 1} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:21 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 2G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-7cafcac1-89ef-4720-8f59-b12ebb974447 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 2G" returned: 0 in 0.166s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.610s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6be8e269-8d62-42b3-ad2e-60daf26439bf,created_at=2026-11-04T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014398615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be8e269-8d62-42b3-ad2e-60daf26439bf,host='devstack@QuobyteHD#QuobyteHD',id=8fb7364c-f59a-4317-9a48-0f2f9e1a2825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='536c5a4e49f047868d327a7a83eb5e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:21Z,use_quota=True,user_id='717a23874acb464e8b00b3a1448745ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afefc188-4a37-4c9a-8cc9-ac2a859495f6),volume_type_id=afefc188-4a37-4c9a-8cc9-ac2a859495f6)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Creating volume 8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:22 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 1073741824 Nov 04 22:24:22 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-194c3aa3-3d3f-4bc0-a9bc-fac0e59c183b tempest-VolumesExtendTest-337480290 None] Extend volume completed successfully. Nov 04 22:24:22 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 1073741824" returned: 0 in 0.514s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:22 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:22 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Flow 'volume_create_manager' (e39b1e3b-144f-4f8d-82f9-2c89ac863c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3715864-5310-4e3d-8cbc-604c3af67e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3715864-5310-4e3d-8cbc-604c3af67e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956705224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3fe234-3d28-474b-922e-45f20215becc,host='devstack@QuobyteHD#QuobyteHD',id=8d34df8b-e985-4a73-9df1-b71289a3ce4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341a7004c074429ebef6c2c63dce2908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:23Z,use_quota=True,user_id='30f72e370185486b9df865b2d7a10d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23c074fa-ec57-4d3a-adbf-47209ddea9f4),volume_type_id=23c074fa-ec57-4d3a-adbf-47209ddea9f4)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9166d-e9f2-4050-809a-693db70e758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9166d-e9f2-4050-809a-693db70e758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b434d793-608c-4225-b969-470993185f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b434d793-608c-4225-b969-470993185f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d34df8b-e985-4a73-9df1-b71289a3ce4b', 'volume_name': 'volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df0b831-f8b8-4f67-9218-b0221bf362e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df0b831-f8b8-4f67-9218-b0221bf362e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392c68c0-ca1d-4e69-a32b-bd33848ff5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Volume 8d34df8b-e985-4a73-9df1-b71289a3ce4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b', 'volume_size': 1} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:22 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-7cafcac1-89ef-4720-8f59-b12ebb974447 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.949s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f5c3e1-65d0-4b49-8781-99d5d5676e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4e4db-1c72-42e2-8d84-a004a81ac7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-7cafcac1-89ef-4720-8f59-b12ebb974447 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f3fe234-3d28-474b-922e-45f20215becc,created_at=2026-11-04T21:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956705224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3fe234-3d28-474b-922e-45f20215becc,host='devstack@QuobyteHD#QuobyteHD',id=8d34df8b-e985-4a73-9df1-b71289a3ce4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341a7004c074429ebef6c2c63dce2908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:23Z,use_quota=True,user_id='30f72e370185486b9df865b2d7a10d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23c074fa-ec57-4d3a-adbf-47209ddea9f4),volume_type_id=23c074fa-ec57-4d3a-adbf-47209ddea9f4)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Creating volume 8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-dbc596a5-dd74-49f7-8d69-5fa0b75d4419-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Volume volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 (8fb7364c-f59a-4317-9a48-0f2f9e1a2825): created successfully Nov 04 22:24:22 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b 1073741824 Nov 04 22:24:22 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4e4db-1c72-42e2-8d84-a004a81ac7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Flow 'volume_create_manager' (9c615801-2fc8-435f-8f52-3ba846372f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-340619e2-adf1-4fb0-8084-686032fc128a tempest-GroupsV314Test-886008324 None] Created volume successfully. Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-dbc596a5-dd74-49f7-8d69-5fa0b75d4419-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-quobyte-dbc596a5-dd74-49f7-8d69-5fa0b75d4419" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-7cafcac1-89ef-4720-8f59-b12ebb974447 tempest-ServerActionsTestOtherA-2018913913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b528ba7-1828-4e24-9eac-6f4eaf7eafb8', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-dbc596a5-dd74-49f7-8d69-5fa0b75d4419" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Deleting offline snapshot dbc596a5-dd74-49f7-8d69-5fa0b75d4419 of volume d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] snapshot_file for this snap is: volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0314a9e-e5c5-4f69-aa5f-c151a1ef004a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-617a95e0-a14b-4b11-9fec-66d2ca67e7f2 req-7cafcac1-89ef-4720-8f59-b12ebb974447 tempest-ServerActionsTestOtherA-2018913913 None] attachment_update completed successfully. Nov 04 22:24:23 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 Nov 04 22:24:23 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:23 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b 1073741824" returned: 0 in 0.543s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:23 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b Nov 04 22:24:23 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:23 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419" returned: 0 in 0.484s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4863927-fca5-4d3e-9234-91eef08c9974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[775beb16-700c-49a6-9c25-290210ef563c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:23 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:23 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:23 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b" returned: 0 in 0.417s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392c68c0-ca1d-4e69-a32b-bd33848ff5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5bfed-b506-4fda-98e7-dfda1b89fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Volume volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b (8d34df8b-e985-4a73-9df1-b71289a3ce4b): created successfully Nov 04 22:24:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5bfed-b506-4fda-98e7-dfda1b89fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Flow 'volume_create_manager' (e39b1e3b-144f-4f8d-82f9-2c89ac863c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4142afcb-b809-4481-ba98-8ae4ac8deedf tempest-GroupSnapshotsV319Test-1051138785 None] Created volume successfully. Nov 04 22:24:24 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.723s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:24 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 Nov 04 22:24:24 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:25 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419" returned: 0 in 0.697s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:25 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419 Nov 04 22:24:25 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:25 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Cloning volume 8fb7364c-f59a-4317-9a48-0f2f9e1a2825 to volume 709944d2-571d-404c-b886-e0386047b262 Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Creating offline snapshot b503a4e2-0185-4be3-aa79-6a216a5a7fff of volume 8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb863b-780d-413a-860c-586538e68f32]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:25 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:25 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:25 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974.dbc596a5-dd74-49f7-8d69-5fa0b75d4419" returned: 0 in 0.524s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-dbc596a5-dd74-49f7-8d69-5fa0b75d4419" released by "_delete_snapshot" :: held 2.618s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" released by "delete_snapshot" :: held 2.670s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] GroupSnapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: creating. Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Created reservations ['565d6340-7558-4fa3-a7d1-f42326dd54de', '81eb5723-0d6a-41b5-9202-a2b025e6b4df', 'a7836528-b56e-43c5-857d-c9bea11ef420', '54b9ff69-6028-4465-bc9f-732008ba3219'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:25 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.664s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Group snapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: creating. {{(pid=87173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 22:24:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:25 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff 1G Nov 04 22:24:25 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Delete snapshot completed successfully. Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43353438-2c32-44fe-9231-b1afdb010ccb tempest-VolumesExtendTest-337480290 None] Lock "cinder-dbc596a5-dd74-49f7-8d69-5fa0b75d4419-delete_snapshot" released by "delete_snapshot" :: held 3.020s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:26 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff 1G" returned: 0 in 0.551s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:26 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:26 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-d4863927-fca5-4d3e-9234-91eef08c9974-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "cinder-d4863927-fca5-4d3e-9234-91eef08c9974-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Acquiring lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:26 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.434s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:26 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec85873-b1f1-468c-8d33-cec91980bc47]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:26 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:26 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:27 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:27 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:27 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:27 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info Nov 04 22:24:27 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:27 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.443s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:27 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974 Nov 04 22:24:27 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:27 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:27 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:27 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info Nov 04 22:24:27 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:27 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4863927-fca5-4d3e-9234-91eef08c9974" returned: 0 in 0.333s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "cinder-quobyte-d4863927-fca5-4d3e-9234-91eef08c9974" released by "delete_volume" :: held 0.869s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Created reservations ['46e0e55b-a6ab-43c0-a9e8-3bc69ef6f726', '6169b233-d483-4bc6-b7de-8c5f6f3bcf12', 'a1ea43c8-9230-4162-9249-6ba70c2f77ee', 'a36aaeb5-178f-4ab0-8e8d-1d00ddb72270'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:28 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:28 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:28 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.info" returned: 0 in 0.566s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Acquiring lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] snapshot: b503a4e2-0185-4be3-aa79-6a216a5a7fff, volume: 709944d2-571d-404c-b886-e0386047b262, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d3c47-3e60-4b91-82a2-79706833b2f5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:28 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.483s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Deleted volume successfully. Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-845f08dd-99d4-448e-a204-412b493dcfc5 tempest-VolumesExtendTest-337480290 None] Lock "cinder-d4863927-fca5-4d3e-9234-91eef08c9974-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:28 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:28 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:28 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.610s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4e70b-1fe2-4b37-869a-03cc8905c4df]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:29 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:29 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:29 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:24:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:24:29 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:24:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:29 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 Nov 04 22:24:29 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (3ef088b5-6e8a-4a8e-b72c-2001768f52b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd03bb47-df1a-4439-b418-eb5a96f0f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd03bb47-df1a-4439-b418-eb5a96f0f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-816689374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7c9a33-ff57-4dc6-8193-6cbcbef329bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:37Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0d605-62e7-4262-94aa-41ddccef2a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0d605-62e7-4262-94aa-41ddccef2a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76127636-73a4-48d2-8d7e-23fdb47eedaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76127636-73a4-48d2-8d7e-23fdb47eedaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7c9a33-ff57-4dc6-8193-6cbcbef329bf', 'volume_name': 'volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc179e53-0724-4d93-8d5b-38c8c6ecc8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc179e53-0724-4d93-8d5b-38c8c6ecc8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cdbbaf-3eb1-4310-8a6a-ae53517dace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Volume 8a7c9a33-ff57-4dc6-8193-6cbcbef329bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf', 'volume_size': 1} Nov 04 22:24:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:39 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262" returned: 0 in 9.948s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:24:39 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Converted 1024.00 MB image at 102.91 MB/s Nov 04 22:24:39 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:39 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 Nov 04 22:24:39 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:39 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" released by "_copy_volume_from_snapshot" :: held 11.635s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Acquiring lock "cinder-quobyte-b503a4e2-0185-4be3-aa79-6a216a5a7fff" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-b503a4e2-0185-4be3-aa79-6a216a5a7fff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Deleting offline snapshot b503a4e2-0185-4be3-aa79-6a216a5a7fff of volume 8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] snapshot_file for this snap is: volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374c973-3530-4c43-8ce8-b92d4a238730]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:40 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:40 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:40 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13ffe9-40e2-4d10-aed2-36aee1425f53]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:40 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:40 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:40 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.545s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:40 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:40 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:41 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.360s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:41 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff Nov 04 22:24:41 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:41 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825.b503a4e2-0185-4be3-aa79-6a216a5a7fff" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-b503a4e2-0185-4be3-aa79-6a216a5a7fff" released by "_delete_snapshot" :: held 1.662s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.478s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.683s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Creating offline snapshot 3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc of volume 8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f0e58-37ee-425a-95fa-ac571119c814]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1d8da266-e911-4e4c-b500-8f5b7c64ad82 tempest-GroupsV314Test-886008324 None] Create group from source-group-6be8e269-8d62-42b3-ad2e-60daf26439bf completed successfully. Nov 04 22:24:41 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b Nov 04 22:24:41 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:42 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:42 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc 1G Nov 04 22:24:42 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:42 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc 1G" returned: 0 in 0.470s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:42 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc Nov 04 22:24:42 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:42 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" returned: 0 in 0.382s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:42 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc Nov 04 22:24:43 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:43 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info Nov 04 22:24:43 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Acquiring lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[894bc4ab-92f5-4594-a6eb-eaeb4004492c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:43 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 Nov 04 22:24:43 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:43 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info Nov 04 22:24:43 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:43 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.info" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.641s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-816689374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7c9a33-ff57-4dc6-8193-6cbcbef329bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:37Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Creating volume 8a7c9a33-ff57-4dc6-8193-6cbcbef329bf {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:43 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262" returned: 0 in 0.449s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:43 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf 1073741824 Nov 04 22:24:43 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:43 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262 Nov 04 22:24:43 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2f5a22a4-ca6d-48e8-8fce-fd8bfb5078c2 tempest-GroupSnapshotsV319Test-1051138785 None] group_snapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: created successfully Nov 04 22:24:44 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-709944d2-571d-404c-b886-e0386047b262" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-709944d2-571d-404c-b886-e0386047b262" released by "delete_volume" :: held 0.808s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Created reservations ['8d381a1a-2c20-47c7-aa98-18e2b81fcc07'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:44 devstack cinder-volume[87173]: WARNING cinder.quota [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2002249939 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2002249939, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:44 devstack cinder-volume[87173]: WARNING cinder.quota [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2002249939 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2002249939, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Created reservations ['76526c3a-b2d6-4967-85a6-1f89d27fb072', '19a5302b-6cf7-4df5-a651-9347255b8210', '740835e0-b545-4db0-9050-7365d689336e', 'b9384246-22fd-4279-9206-47b6fe8ce865'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:44 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf 1073741824" returned: 0 in 0.542s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:44 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf Nov 04 22:24:44 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:44 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:44 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:44 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] group_snapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: deleting Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3f28e909-dacf-41e3-aa3a-390a6dc81694 tempest-GroupsV314Test-886008324 None] Delete group completed successfully. Nov 04 22:24:44 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] group_snapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: deleting {{(pid=87173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cdbbaf-3eb1-4310-8a6a-ae53517dace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c3e6ff-b80a-42d3-959f-ee0d021c78ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Volume volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf (8a7c9a33-ff57-4dc6-8193-6cbcbef329bf): created successfully Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c3e6ff-b80a-42d3-959f-ee0d021c78ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (3ef088b5-6e8a-4a8e-b72c-2001768f52b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-71ec95f3-cd88-414b-bb51-5f5b1841aaf3 tempest-VolumesListTestJSON-2048866292 None] Created volume successfully. Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "cinder-quobyte-3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Deleting offline snapshot 3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc of volume 8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] snapshot_file for this snap is: volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecec6b-05ea-4191-afe0-9f9dcf5ee068]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Acquiring lock "cinder-quobyte-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58386c-1c5a-4cae-80fd-d084aa683c98]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:45 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc Nov 04 22:24:45 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:45 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:45 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:45 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" returned: 0 in 0.384s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c500fa-f68e-4e94-b499-ef99fde0e478]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:45 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:45 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825 Nov 04 22:24:45 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:45 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b Nov 04 22:24:45 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:45 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Lock "cinder-quobyte-8fb7364c-f59a-4317-9a48-0f2f9e1a2825" released by "delete_volume" :: held 0.796s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:45 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b" returned: 0 in 0.414s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:45 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc Nov 04 22:24:45 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:45 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Created reservations ['f96251b2-4b38-4d8b-bb07-6a8346b7bd9e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Created reservations ['1c28f598-20a9-4367-b2c0-0bed99bf5218', '0c775596-32b7-4759-8f80-d060d8ba4131', 'ad243094-8d29-49b8-b04e-66c16edfe83c', '3de9bcc7-3880-48ab-b7cd-42517df78059'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (52187aff-e17b-4014-acdf-20288ff8e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1682589-754d-4258-befc-079ec3906590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1682589-754d-4258-befc-079ec3906590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525718362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee2627e-05a0-4994-ab50-b7444a23462b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:46Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc0c792-d49e-43d1-9c4b-b25cf1df5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc0c792-d49e-43d1-9c4b-b25cf1df5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53674772-ddc3-4d9d-a729-6b870788e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53674772-ddc3-4d9d-a729-6b870788e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee2627e-05a0-4994-ab50-b7444a23462b', 'volume_name': 'volume-9ee2627e-05a0-4994-ab50-b7444a23462b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64eaeb7-3780-4a48-a00d-c402bd86cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64eaeb7-3780-4a48-a00d-c402bd86cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd9d22-b1c5-44a1-86eb-4774824c4d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Volume 9ee2627e-05a0-4994-ab50-b7444a23462b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee2627e-05a0-4994-ab50-b7444a23462b', 'volume_size': 1} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525718362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee2627e-05a0-4994-ab50-b7444a23462b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:46Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Creating volume 9ee2627e-05a0-4994-ab50-b7444a23462b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:46 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:46 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" returned: 0 in 0.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:46 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b 1073741824 Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:46 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:46 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc Nov 04 22:24:46 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:46 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:46 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:46 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b.3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:46 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.297s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-3be1c93f-eb9a-4d62-bfa0-c81235c3fbbc" released by "_delete_snapshot" :: held 1.691s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e7825c38-7eb2-4d4a-8b08-4710dd436615 tempest-GroupsV314Test-886008324 None] Delete group completed successfully. Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" released by "delete_snapshot" :: held 1.735s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:46 devstack cinder-volume[87173]: WARNING cinder.quota [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-801881596 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-801881596, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:46 devstack cinder-volume[87173]: WARNING cinder.quota [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-801881596 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-801881596, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] Created reservations ['e592093d-43f2-43a6-8122-8b3be78eb22f', '1a21054b-ec40-414b-8712-e702ffcd42e2', '02765c33-5e9b-41ec-9522-c0c66b0965a4', '1fb67ecf-f6be-416c-abbe-af3e762760e5'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:46 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b 1073741824" returned: 0 in 0.540s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c13b1dfc-e820-40e4-a78f-94493450611f tempest-GroupSnapshotsV319Test-1051138785 None] group_snapshot 376aff0c-620b-4bd1-a21a-4fe634086b73: deleted successfully Nov 04 22:24:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:46 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b Nov 04 22:24:46 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:47 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b" returned: 0 in 0.256s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd9d22-b1c5-44a1-86eb-4774824c4d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee2627e-05a0-4994-ab50-b7444a23462b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a73892d-1ddb-404b-8dfb-acf4ad5d6f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Volume volume-9ee2627e-05a0-4994-ab50-b7444a23462b (9ee2627e-05a0-4994-ab50-b7444a23462b): created successfully Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a73892d-1ddb-404b-8dfb-acf4ad5d6f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (52187aff-e17b-4014-acdf-20288ff8e620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-efb30843-6dde-4ebe-af70-fae97f5273d0 tempest-VolumesListTestJSON-2048866292 None] Created volume successfully. Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[44298561-2d35-4f90-89a4-b6ce26ba69dd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:47 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b Nov 04 22:24:47 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:47 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:47 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b Nov 04 22:24:47 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:48 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d34df8b-e985-4a73-9df1-b71289a3ce4b" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Lock "cinder-quobyte-8d34df8b-e985-4a73-9df1-b71289a3ce4b" released by "delete_volume" :: held 0.755s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Created reservations ['d561a0fd-7a7b-425b-bb2e-838cc1006a9b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:48 devstack cinder-volume[87173]: WARNING cinder.quota [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-801881596 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-801881596, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Created reservations ['e5cd4e22-03df-4f11-b72b-c1b5e883f843', '00276f7e-8db6-4913-a968-8ce2f6371968', 'f5d318f3-3858-455c-bde0-2b1e7d11db18', '3522faf2-7454-4781-9679-890c8908c255'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:48 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:48 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:48 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.323s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3361faa5-ed22-4cd4-b72c-4e8e4818162a tempest-GroupSnapshotsV319Test-1051138785 None] Delete group completed successfully. Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (18f2f3e1-91c2-4a08-8ce1-66e215c66fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5caa3e-779b-41e2-9f50-417ff9fd4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5caa3e-779b-41e2-9f50-417ff9fd4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-950691558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4046ca9a-4200-49ec-a530-687ff2c9edb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:49Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5836c1-6a4f-43bc-93e3-b807794443dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5836c1-6a4f-43bc-93e3-b807794443dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bff46c-c962-4643-ab1d-c88eb9bdfca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bff46c-c962-4643-ab1d-c88eb9bdfca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4046ca9a-4200-49ec-a530-687ff2c9edb8', 'volume_name': 'volume-4046ca9a-4200-49ec-a530-687ff2c9edb8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b3bebe-0b78-4cce-b407-a94698a6b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b3bebe-0b78-4cce-b407-a94698a6b29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ff803-ebc8-473e-8191-9f4826a54584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Volume 4046ca9a-4200-49ec-a530-687ff2c9edb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4046ca9a-4200-49ec-a530-687ff2c9edb8', 'volume_size': 1} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-950691558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4046ca9a-4200-49ec-a530-687ff2c9edb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4536a89aad349ba86535a3e3851b347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:24:49Z,use_quota=True,user_id='7425b4810ba245d3b74f0e1704e80839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Creating volume 4046ca9a-4200-49ec-a530-687ff2c9edb8 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:24:48 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:24:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:49 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 1073741824 Nov 04 22:24:49 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:49 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 1073741824" returned: 0 in 0.554s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:49 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 Nov 04 22:24:49 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:49 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8" returned: 0 in 0.290s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ff803-ebc8-473e-8191-9f4826a54584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4046ca9a-4200-49ec-a530-687ff2c9edb8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e17329-fead-4df4-847c-19d5f0828edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:24:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Volume volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 (4046ca9a-4200-49ec-a530-687ff2c9edb8): created successfully Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e17329-fead-4df4-847c-19d5f0828edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:24:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Flow 'volume_create_manager' (18f2f3e1-91c2-4a08-8ce1-66e215c66fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:24:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e9bc8cae-587f-4fd6-9730-fd06cb57bab8 tempest-VolumesListTestJSON-2048866292 None] Created volume successfully. Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-4046ca9a-4200-49ec-a530-687ff2c9edb8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-4046ca9a-4200-49ec-a530-687ff2c9edb8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-quobyte-4046ca9a-4200-49ec-a530-687ff2c9edb8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-4046ca9a-4200-49ec-a530-687ff2c9edb8" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb07ee6b-f9c3-44df-9040-bed0159b1e3a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:53 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 Nov 04 22:24:53 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:54 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8" returned: 0 in 0.492s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:54 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8 Nov 04 22:24:54 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:54 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4046ca9a-4200-49ec-a530-687ff2c9edb8" returned: 0 in 0.360s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-4046ca9a-4200-49ec-a530-687ff2c9edb8" released by "delete_volume" :: held 0.910s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Created reservations ['84c177e7-3ebc-497c-bdd7-1fcaf81340f1', '03da65b1-e663-47c2-9157-e4919f55c164', 'a6f9d798-28b1-4e0a-88db-53c1ed0e2c7e', 'f73c39b9-576a-4bfd-b51d-759cfa5c2dc1'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:54 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:54 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-9ee2627e-05a0-4994-ab50-b7444a23462b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-9ee2627e-05a0-4994-ab50-b7444a23462b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-quobyte-9ee2627e-05a0-4994-ab50-b7444a23462b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-9ee2627e-05a0-4994-ab50-b7444a23462b" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a7a66-cd75-4de9-abef-646eb3a5f43a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:55 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Deleted volume successfully. Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d86a01f6-c257-492c-ba10-25068e8f2ac9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-4046ca9a-4200-49ec-a530-687ff2c9edb8-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:55 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b Nov 04 22:24:55 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:55 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b" returned: 0 in 0.582s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:55 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b Nov 04 22:24:55 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:56 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9ee2627e-05a0-4994-ab50-b7444a23462b" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-9ee2627e-05a0-4994-ab50-b7444a23462b" released by "delete_volume" :: held 1.064s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Created reservations ['f3ca6698-4265-4bdd-aa96-9123e29649ab', '2f511d0e-e577-405c-bf5d-9e72afdf2b38', 'c92a7eed-ea69-4165-9f01-15492e80190b', '31834089-f74c-4c2c-8670-96a9c33778e4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:56 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:56 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:56 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:56 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:56 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.414s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Deleted volume successfully. Nov 04 22:24:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f0c82850-c3ad-4406-87c5-7838b88c7d7b tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-9ee2627e-05a0-4994-ab50-b7444a23462b-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:57 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.410s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "cinder-quobyte-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f827328-9974-4bce-880d-79041c8c0c6a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:57 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf Nov 04 22:24:57 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-f4fdd1a2-9589-44a3-bd1b-d94e2605dbc2 tempest-ServerActionsTestOtherA-2018913913 None] Terminate volume connection completed successfully. Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-f4fdd1a2-9589-44a3-bd1b-d94e2605dbc2 tempest-ServerActionsTestOtherA-2018913913 None] Deleting attachment 5b528ba7-1828-4e24-9eac-6f4eaf7eafb8. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:24:58 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" returned: 0 in 0.594s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:58 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf Nov 04 22:24:58 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "cinder-56c179d9-10c5-4d06-97a0-c16ed2efd27e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-56c179d9-10c5-4d06-97a0-c16ed2efd27e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "cinder-quobyte-56c179d9-10c5-4d06-97a0-c16ed2efd27e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-quobyte-56c179d9-10c5-4d06-97a0-c16ed2efd27e" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:24:58 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f33399b-c466-4f78-829c-d54c8273daf9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" returned: 0 in 0.312s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-quobyte-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf" released by "delete_volume" :: held 0.989s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Created reservations ['a3c08341-f00a-4e7a-a18b-94db51decabc', '60a8426c-58e8-42b8-906c-ddd2425d037d', '550164f2-2ef6-4c6a-9644-09c4b1724ce1', '7fc20d9c-f7fe-4803-b4e7-df7d84b76acc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:58 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e Nov 04 22:24:58 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:58 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:58 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:59 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e" returned: 0 in 0.688s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:59 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.494s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Deleted volume successfully. Nov 04 22:24:59 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e Nov 04 22:24:59 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-492b3ad9-59ac-40f9-8f3b-facf6b8017c9 tempest-VolumesListTestJSON-2048866292 None] Lock "cinder-8a7c9a33-ff57-4dc6-8193-6cbcbef329bf-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:59 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-56c179d9-10c5-4d06-97a0-c16ed2efd27e" returned: 0 in 0.310s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-quobyte-56c179d9-10c5-4d06-97a0-c16ed2efd27e" released by "delete_volume" :: held 1.069s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.quota [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Created reservations ['90ec102a-90d0-41df-9b77-daff3aa4490d', '9cb605a5-697d-495f-90ba-2c9a2c18d8c6', '147a0ffe-6136-4d14-9f6c-bb6e27183e29', '7475db13-4cef-4283-bac8-8223a9abd76f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:24:59 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:24:59 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:24:59 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:24:59 devstack cinder-volume[87173]: DEBUG cinder.manager [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:24:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Deleted volume successfully. Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-aad44b89-2ca9-42c9-8085-f30e77d5e7ea req-7a1f28bc-039c-44b3-ab5a-414db080cd36 tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-56c179d9-10c5-4d06-97a0-c16ed2efd27e-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "cinder-76e8d806-096c-4013-b131-52e659de1275-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-76e8d806-096c-4013-b131-52e659de1275-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "cinder-quobyte-76e8d806-096c-4013-b131-52e659de1275" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-quobyte-76e8d806-096c-4013-b131-52e659de1275" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b8b34-dd88-4ab9-aee1-dc3a61b1089f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:00 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 Nov 04 22:25:00 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:00 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275" returned: 0 in 0.589s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:00 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275 Nov 04 22:25:00 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:01 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76e8d806-096c-4013-b131-52e659de1275" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-quobyte-76e8d806-096c-4013-b131-52e659de1275" released by "delete_volume" :: held 1.043s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Created reservations ['2766513d-caf6-4410-8adc-fc6df9e25181', 'f840d8eb-ac50-4ab6-b085-9e4fea7d7f0c', '588cc42c-4dab-4946-b2b3-60f5dcd079fb', '2fe9ef45-42ab-40a9-839e-e0012d5622fe'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:01 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:01 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:01 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.312s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Deleted volume successfully. Nov 04 22:25:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0619ff9e-f00c-49b4-ae06-15c2d968c63c tempest-ServerActionsTestOtherA-2018913913 None] Lock "cinder-76e8d806-096c-4013-b131-52e659de1275-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Flow 'volume_create_manager' (9f2f51c0-2d57-41a1-9fb3-ae4b7f546e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2854eac-9479-47a8-8193-40fca30e45aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2854eac-9479-47a8-8193-40fca30e45aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-63702196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176d4431-0408-4b68-be12-6aa38d05042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98058a884f74c569722853950683855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:06Z,use_quota=True,user_id='1f112cdf128c43c5bc4a5cc618e9abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafe14ae-c67a-4ca9-a6ea-18485208703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafe14ae-c67a-4ca9-a6ea-18485208703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06bccb4-ba39-44b5-b9dc-492a3b08f895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06bccb4-ba39-44b5-b9dc-492a3b08f895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176d4431-0408-4b68-be12-6aa38d05042b', 'volume_name': 'volume-176d4431-0408-4b68-be12-6aa38d05042b', 'volume_size': 2}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8646dd50-c161-4b6f-bf60-ce7198d6e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8646dd50-c161-4b6f-bf60-ce7198d6e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8071553-20e8-4783-b404-944fc0fa60b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:05 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Volume 176d4431-0408-4b68-be12-6aa38d05042b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176d4431-0408-4b68-be12-6aa38d05042b', 'volume_size': 2} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-63702196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176d4431-0408-4b68-be12-6aa38d05042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98058a884f74c569722853950683855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:06Z,use_quota=True,user_id='1f112cdf128c43c5bc4a5cc618e9abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Creating volume 176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:05 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b 2147483648 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:05 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b 2147483648 Nov 04 22:25:05 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:06 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b 2147483648" returned: 0 in 0.728s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:06 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b Nov 04 22:25:06 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:06 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b" returned: 0 in 0.315s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8071553-20e8-4783-b404-944fc0fa60b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176d4431-0408-4b68-be12-6aa38d05042b', 'volume_size': 2}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf6c7ae-20d9-465f-9e1b-31c8fba6f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Volume volume-176d4431-0408-4b68-be12-6aa38d05042b (176d4431-0408-4b68-be12-6aa38d05042b): created successfully Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf6c7ae-20d9-465f-9e1b-31c8fba6f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Flow 'volume_create_manager' (9f2f51c0-2d57-41a1-9fb3-ae4b7f546e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-330e4741-22f2-4a55-9743-c9580c2cf638 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Created volume successfully. Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Creating offline snapshot 76036e3e-b24e-4596-a746-2ba04a14000a of volume 176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc865b8-a0aa-4931-a38d-1645f995d5ac]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:08 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b Nov 04 22:25:08 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:08 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b" returned: 0 in 0.542s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a 2G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:08 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a 2G Nov 04 22:25:08 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:09 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a 2G" returned: 0 in 0.587s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-176d4431-0408-4b68-be12-6aa38d05042b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:09 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-176d4431-0408-4b68-be12-6aa38d05042b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a Nov 04 22:25:09 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:09 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-176d4431-0408-4b68-be12-6aa38d05042b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a" returned: 0 in 0.430s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:09 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a is being set with open permissions: ugo+rw Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:09 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a Nov 04 22:25:09 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:09 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:09 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info Nov 04 22:25:09 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:10 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info" returned: 0 in 0.295s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:10 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info is being set with open permissions: ugo+rw Nov 04 22:25:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:10 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info Nov 04 22:25:10 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:10 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.info" returned: 0 in 0.381s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-60c96c06-cb5c-4295-9129-bcc6d9ff7b5d tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Create snapshot completed successfully Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "cinder-76036e3e-b24e-4596-a746-2ba04a14000a-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-76036e3e-b24e-4596-a746-2ba04a14000a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "cinder-quobyte-76036e3e-b24e-4596-a746-2ba04a14000a" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-76036e3e-b24e-4596-a746-2ba04a14000a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Deleting offline snapshot 76036e3e-b24e-4596-a746-2ba04a14000a of volume 176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] snapshot_file for this snap is: volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[017dcbde-cedb-4cdd-9c05-486da07ebac4]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:11 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a Nov 04 22:25:11 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:11 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a" returned: 0 in 0.463s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-176d4431-0408-4b68-be12-6aa38d05042b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8996ba0-9db8-4684-80ba-5d38a3088766]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:12 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b Nov 04 22:25:12 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:12 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:12 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a Nov 04 22:25:12 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:12 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a" returned: 0 in 0.434s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:12 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a Nov 04 22:25:12 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:13 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b.76036e3e-b24e-4596-a746-2ba04a14000a" returned: 0 in 0.389s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-76036e3e-b24e-4596-a746-2ba04a14000a" released by "_delete_snapshot" :: held 1.921s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" released by "delete_snapshot" :: held 1.953s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Created reservations ['76867fda-c5d6-41c2-979f-4d7a80b1aa8a', '03c0f75b-cc16-4e4a-8e07-aa1f4a5cf420', '6aea3ee0-4e7a-4496-9343-7454031c5ad5', '3755a28e-66e9-4744-bba3-20c791c945dc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Delete snapshot completed successfully. Nov 04 22:25:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f15153e3-f630-43f6-8146-6a52b5178430 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-76036e3e-b24e-4596-a746-2ba04a14000a-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "cinder-176d4431-0408-4b68-be12-6aa38d05042b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-176d4431-0408-4b68-be12-6aa38d05042b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd9929c-e86d-4d44-a4ac-06d89fdf3a10]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:14 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b Nov 04 22:25:14 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:15 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b" returned: 0 in 0.503s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:15 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b Nov 04 22:25:15 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:15 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-176d4431-0408-4b68-be12-6aa38d05042b" returned: 0 in 0.387s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-quobyte-176d4431-0408-4b68-be12-6aa38d05042b" released by "delete_volume" :: held 0.992s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=134,cinder:SELECT=118,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=122,cinder:INSERT=30,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Created reservations ['db990df5-7009-4c7e-96ff-1e83f4c1f995', '1cab7b63-ccdf-47ec-a3db-d579776b5c3f', '7e6055b0-b232-4f28-a234-7a1ef6845f66', '0909b519-699c-4bac-919a-4e31ff23562f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Flow 'volume_create_manager' (1dc37797-ec92-4507-acc0-2ae35624a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0047024-bea8-442d-8fd9-f32895ce831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0047024-bea8-442d-8fd9-f32895ce831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-404408729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7519cd96-19c1-4851-b7cc-76854afaa420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4946ae3525e453cb193905e0f3a5fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:16Z,use_quota=True,user_id='bec140692b294ea5bdc42d1581dbfa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02f07fb-df47-423c-9e70-98704c9f64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02f07fb-df47-423c-9e70-98704c9f64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59583c6-95bd-425d-bb9c-5b8e87794495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:15 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:16 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:16 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:16 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Deleted volume successfully. Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8f8f1baa-2a5a-422d-b383-f090786a3ef9 tempest-VolumesSnapshotNegativeTestJSON-486237056 None] Lock "cinder-176d4431-0408-4b68-be12-6aa38d05042b-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59583c6-95bd-425d-bb9c-5b8e87794495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7519cd96-19c1-4851-b7cc-76854afaa420', 'volume_name': 'volume-7519cd96-19c1-4851-b7cc-76854afaa420', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483ffaf7-0a5a-484b-9393-83c58d7d96dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483ffaf7-0a5a-484b-9393-83c58d7d96dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084f2f2a-a053-4163-8232-c63883a445b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Volume 7519cd96-19c1-4851-b7cc-76854afaa420: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7519cd96-19c1-4851-b7cc-76854afaa420', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 22:25:16 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Trying to clone 7519cd96-19c1-4851-b7cc-76854afaa420 from image 728a9578-311c-407d-85c9-cd39797548f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:25:17 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Image download 20.69 MB at 20.69 MB/s Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1d5d4-edd7-4751-a435-6faf55164889]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:17 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD Nov 04 22:25:17 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:17 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 is fetched for user bec140692b294ea5bdc42d1581dbfa58. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679efe0-f305-454d-a175-655cae83252e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:17 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD Nov 04 22:25:17 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:18 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-404408729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7519cd96-19c1-4851-b7cc-76854afaa420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4946ae3525e453cb193905e0f3a5fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:16Z,use_quota=True,user_id='bec140692b294ea5bdc42d1581dbfa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Creating volume 7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:18 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:18 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1073741824 Nov 04 22:25:18 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:18 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1073741824" returned: 0 in 0.604s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:18 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 Nov 04 22:25:18 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:19 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420" returned: 0 in 0.350s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Attempting download of 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 7519cd96-19c1-4851-b7cc-76854afaa420. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a3584a-7d3a-4e44-9e46-a87ba880d779]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:19 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre Nov 04 22:25:19 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:19 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:19 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre Nov 04 22:25:19 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Flow 'volume_create_manager' (69eb46c9-1bc9-4573-b522-9b3c7b922ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4513f962-6640-4e05-8139-e2c7a0aab15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:20 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4513f962-6640-4e05-8139-e2c7a0aab15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1278470560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498caf55-b504-472b-89e3-8bd59d14d2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8016a8cec6471b9d4f4f50408adb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:20Z,use_quota=True,user_id='78d2cbb967154971a8f28a4a45cf05ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11eae58-a2ec-4ed8-b173-433f6dd76ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11eae58-a2ec-4ed8-b173-433f6dd76ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54afff6-032b-4811-ac2b-697cc8bd6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54afff6-032b-4811-ac2b-697cc8bd6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498caf55-b504-472b-89e3-8bd59d14d2b8', 'volume_name': 'volume-498caf55-b504-472b-89e3-8bd59d14d2b8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3cfbf3-ddb4-4227-8671-4fc45f1e3e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3cfbf3-ddb4-4227-8671-4fc45f1e3e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4ce851-9163-464a-8e20-a19984757858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:20 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Volume 498caf55-b504-472b-89e3-8bd59d14d2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498caf55-b504-472b-89e3-8bd59d14d2b8', 'volume_size': 1} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1278470560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498caf55-b504-472b-89e3-8bd59d14d2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8016a8cec6471b9d4f4f50408adb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:20Z,use_quota=True,user_id='78d2cbb967154971a8f28a4a45cf05ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Creating volume 498caf55-b504-472b-89e3-8bd59d14d2b8 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:20 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre" returned: 1 in 0.464s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_6gm0rrre' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[633a068d-4817-43f6-bbee-69f2328af1aa]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:20 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 1073741824 Nov 04 22:25:20 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:20 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD Nov 04 22:25:20 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:20 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] 728a9578-311c-407d-85c9-cd39797548f0 was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:20 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 Nov 04 22:25:20 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:20 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 1073741824" returned: 0 in 0.637s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:20 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 Nov 04 22:25:20 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:21 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8" returned: 0 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4ce851-9163-464a-8e20-a19984757858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498caf55-b504-472b-89e3-8bd59d14d2b8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12731767-dbc5-469e-b3f7-2b6b67207330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Volume volume-498caf55-b504-472b-89e3-8bd59d14d2b8 (498caf55-b504-472b-89e3-8bd59d14d2b8): created successfully Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12731767-dbc5-469e-b3f7-2b6b67207330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Flow 'volume_create_manager' (69eb46c9-1bc9-4573-b522-9b3c7b922ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4379e2fc-4094-4967-82a7-b6310f53c2b4 tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Created volume successfully. Nov 04 22:25:23 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420" returned: 0 in 2.651s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_b_1clxr4devstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:25:23 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Converted 112.00 MB image at 42.21 MB/s Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:23 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1G Nov 04 22:25:23 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:23 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 1G" returned: 0 in 0.504s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Downloaded image 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 7519cd96-19c1-4851-b7cc-76854afaa420 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 for user bec140692b294ea5bdc42d1581dbfa58 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Marking volume 7519cd96-19c1-4851-b7cc-76854afaa420 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Copying metadata from image 728a9578-311c-407d-85c9-cd39797548f0 to 7519cd96-19c1-4851-b7cc-76854afaa420. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Creating volume glance metadata for volume 7519cd96-19c1-4851-b7cc-76854afaa420 backed by image 728a9578-311c-407d-85c9-cd39797548f0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:25:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Acquiring lock "cinder-498caf55-b504-472b-89e3-8bd59d14d2b8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "cinder-498caf55-b504-472b-89e3-8bd59d14d2b8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084f2f2a-a053-4163-8232-c63883a445b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7519cd96-19c1-4851-b7cc-76854afaa420', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a1ace-0cb6-4569-927b-6ce53d1c2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Volume volume-7519cd96-19c1-4851-b7cc-76854afaa420 (7519cd96-19c1-4851-b7cc-76854afaa420): created successfully Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a1ace-0cb6-4569-927b-6ce53d1c2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Flow 'volume_create_manager' (1dc37797-ec92-4507-acc0-2ae35624a318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Acquiring lock "cinder-quobyte-498caf55-b504-472b-89e3-8bd59d14d2b8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-340cf428-0517-431c-8191-6d0810b602b0 tempest-VolumesImageMetadata-2064138304 None] Created volume successfully. Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "cinder-quobyte-498caf55-b504-472b-89e3-8bd59d14d2b8" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d706329c-5c0b-4d2a-ae17-01e024c2c926]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:24 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 Nov 04 22:25:24 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:24 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:24 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8 Nov 04 22:25:24 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:24 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-498caf55-b504-472b-89e3-8bd59d14d2b8" returned: 0 in 0.268s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "cinder-quobyte-498caf55-b504-472b-89e3-8bd59d14d2b8" released by "delete_volume" :: held 0.774s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:24 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Created reservations ['6d889780-19cd-4bfd-ad1b-f41add80747f', 'edaf9f37-12cf-425f-a746-1ea54ed2b0ca', '03aeb9e3-66b8-45ae-b288-e859939df375', 'b03e819b-0e93-465f-8e1c-07f6920a4b6d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:25 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:25 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:25 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Deleted volume successfully. Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd69527d-9d1f-47f6-8678-9b93f36ca9df tempest-VolumeQuotasNegativeTestJSON-1627012228 None] Lock "cinder-498caf55-b504-472b-89e3-8bd59d14d2b8-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Acquiring lock "cinder-7519cd96-19c1-4851-b7cc-76854afaa420-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "cinder-7519cd96-19c1-4851-b7cc-76854afaa420-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Acquiring lock "cinder-quobyte-7519cd96-19c1-4851-b7cc-76854afaa420" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "cinder-quobyte-7519cd96-19c1-4851-b7cc-76854afaa420" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f8efc-f598-4ec6-a63b-a288c2b0632c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:25 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 Nov 04 22:25:25 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:26 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420" returned: 0 in 0.469s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:26 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420 Nov 04 22:25:26 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:26 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7519cd96-19c1-4851-b7cc-76854afaa420" returned: 0 in 0.343s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "cinder-quobyte-7519cd96-19c1-4851-b7cc-76854afaa420" released by "delete_volume" :: held 0.877s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Created reservations ['eefc73e9-fbbf-4fd5-a5c2-90c232d045e8', '729b14a5-a18f-44a6-ab25-d7dcc0341c27', '200d45c0-eecd-4c02-a649-8a40b0fe22e3', '4374af8a-b761-479e-9042-d5a5fdb766df'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:26 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:26 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:27 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:27 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Deleted volume successfully. Nov 04 22:25:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-541a7e4a-d6ff-4459-b6be-9a6ef9512074 tempest-VolumesImageMetadata-2064138304 None] Lock "cinder-7519cd96-19c1-4851-b7cc-76854afaa420-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:36 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=27,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Flow 'volume_create_manager' (fdca32d8-525d-4b45-8cf5-3572e848db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824b0430-1c2b-40cf-8e97-ce57ad4900c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824b0430-1c2b-40cf-8e97-ce57ad4900c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1398733324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daadb38d-d02b-40f5-902d-6a60e3470689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5fe99520434f18905e6b27280ef38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:38Z,use_quota=True,user_id='c36db6a05bb34fe1b736bb2d65e4f000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3629eae1-b679-4a3e-88ec-c7e4834bc2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3629eae1-b679-4a3e-88ec-c7e4834bc2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca5c555-8b9a-4b4d-b8b5-bb7105191c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca5c555-8b9a-4b4d-b8b5-bb7105191c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daadb38d-d02b-40f5-902d-6a60e3470689', 'volume_name': 'volume-daadb38d-d02b-40f5-902d-6a60e3470689', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047f0acc-ce39-4659-b4dd-d0c4881a2165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047f0acc-ce39-4659-b4dd-d0c4881a2165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e712e2e5-05f0-4675-9465-a6ec6659252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Volume daadb38d-d02b-40f5-902d-6a60e3470689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daadb38d-d02b-40f5-902d-6a60e3470689', 'volume_size': 1} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1398733324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daadb38d-d02b-40f5-902d-6a60e3470689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5fe99520434f18905e6b27280ef38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:38Z,use_quota=True,user_id='c36db6a05bb34fe1b736bb2d65e4f000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Creating volume daadb38d-d02b-40f5-902d-6a60e3470689 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:37 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:38 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 1073741824 Nov 04 22:25:38 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:38 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 1073741824" returned: 0 in 0.683s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:38 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 Nov 04 22:25:38 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:39 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e712e2e5-05f0-4675-9465-a6ec6659252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daadb38d-d02b-40f5-902d-6a60e3470689', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cad5cf-582c-4a6e-bbda-00ecc3b87e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Volume volume-daadb38d-d02b-40f5-902d-6a60e3470689 (daadb38d-d02b-40f5-902d-6a60e3470689): created successfully Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cad5cf-582c-4a6e-bbda-00ecc3b87e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Flow 'volume_create_manager' (fdca32d8-525d-4b45-8cf5-3572e848db32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:39 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-046a3235-9159-45f8-be8b-a16896f4929b tempest-AbsoluteLimitsTests-636107744 None] Created volume successfully. Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Flow 'volume_create_manager' (1b70f68b-8a62-4ec1-b1e0-cd3bf22ae603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba0371d-25da-4ed3-b8db-d87f7b1569bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Acquiring lock "cinder-daadb38d-d02b-40f5-902d-6a60e3470689-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "cinder-daadb38d-d02b-40f5-902d-6a60e3470689-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba0371d-25da-4ed3-b8db-d87f7b1569bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-12874940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25553bed-eaa6-4692-aaf6-40522d2a9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a98da4310184e619c5755a9b3630d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:40Z,use_quota=True,user_id='052ef89280054db299d85799581cd24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cea5a70-5dbd-48fb-8928-c27871389b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cea5a70-5dbd-48fb-8928-c27871389b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c603cd8-1cb6-47e8-b446-35d0773261e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c603cd8-1cb6-47e8-b446-35d0773261e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25553bed-eaa6-4692-aaf6-40522d2a9b06', 'volume_name': 'volume-25553bed-eaa6-4692-aaf6-40522d2a9b06', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756937a9-1331-42ba-996d-71527f0477ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756937a9-1331-42ba-996d-71527f0477ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798d426b-ed15-4bec-b7c1-ea08c81eba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Volume 25553bed-eaa6-4692-aaf6-40522d2a9b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25553bed-eaa6-4692-aaf6-40522d2a9b06', 'volume_size': 1} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-12874940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25553bed-eaa6-4692-aaf6-40522d2a9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a98da4310184e619c5755a9b3630d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:40Z,use_quota=True,user_id='052ef89280054db299d85799581cd24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Creating volume 25553bed-eaa6-4692-aaf6-40522d2a9b06 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:40 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:40 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 1073741824 Nov 04 22:25:40 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Acquiring lock "cinder-quobyte-daadb38d-d02b-40f5-902d-6a60e3470689" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "cinder-quobyte-daadb38d-d02b-40f5-902d-6a60e3470689" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[701ddc3a-957e-48b2-9e5d-dc5095dce50a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:40 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 Nov 04 22:25:40 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:41 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 1073741824" returned: 0 in 0.611s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:41 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:41 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689 Nov 04 22:25:41 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:41 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 Nov 04 22:25:41 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:41 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06" returned: 0 in 0.339s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798d426b-ed15-4bec-b7c1-ea08c81eba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25553bed-eaa6-4692-aaf6-40522d2a9b06', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a359f03-5603-43f8-a526-8b13b274cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:41 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Volume volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 (25553bed-eaa6-4692-aaf6-40522d2a9b06): created successfully Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a359f03-5603-43f8-a526-8b13b274cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Flow 'volume_create_manager' (1b70f68b-8a62-4ec1-b1e0-cd3bf22ae603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:41 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-daadb38d-d02b-40f5-902d-6a60e3470689" returned: 0 in 0.467s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "cinder-quobyte-daadb38d-d02b-40f5-902d-6a60e3470689" released by "delete_volume" :: held 1.040s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0c4cd6d2-0e84-4f19-940d-05be2d2f13b8 tempest-VolumesServicesTestJSON-1869237353 None] Created volume successfully. Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Created reservations ['0c242290-e620-4cea-a9a2-f6e5c5716175', '253b1727-0a4d-43c4-bbf9-9f2008e7e8ec', '35b6834b-2bb6-4aa4-b484-17abacde9000', '080f09cf-b596-40db-be5a-d5b74e71fdb9'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:41 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:41 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:42 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.654s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Deleted volume successfully. Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cd46862-85b4-4706-a52b-d77428e93c24 tempest-AbsoluteLimitsTests-636107744 None] Lock "cinder-daadb38d-d02b-40f5-902d-6a60e3470689-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Acquiring lock "cinder-25553bed-eaa6-4692-aaf6-40522d2a9b06-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "cinder-25553bed-eaa6-4692-aaf6-40522d2a9b06-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Acquiring lock "cinder-quobyte-25553bed-eaa6-4692-aaf6-40522d2a9b06" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:25:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "cinder-quobyte-25553bed-eaa6-4692-aaf6-40522d2a9b06" acquired by "delete_volume" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:25:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[37edc565-14af-46ce-a6cb-e2dbf6ab75d0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:25:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:43 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 Nov 04 22:25:43 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:43 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06" returned: 0 in 0.693s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:43 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06 Nov 04 22:25:43 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:44 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-25553bed-eaa6-4692-aaf6-40522d2a9b06" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "cinder-quobyte-25553bed-eaa6-4692-aaf6-40522d2a9b06" released by "delete_volume" :: held 1.188s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Created reservations ['78ea62ab-7d4c-4799-8917-e78c7973a088', 'e991592a-7f44-445a-aa79-53396e0e3319', '5377614b-b6d4-4d6d-9de6-bd3527bfff3b', '580ff7cc-ea45-4c8b-b100-cced377d7336'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:44 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:44 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:44 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Deleted volume successfully. Nov 04 22:25:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-70b7f766-9b8c-441e-9dcb-a84ec75effd6 tempest-VolumesServicesTestJSON-1869237353 None] Lock "cinder-25553bed-eaa6-4692-aaf6-40522d2a9b06-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:25:54 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=29,cinder:SELECT=13,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:54 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (e97cfa3b-d738-49e4-977c-f8d452926ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce28a3c5-f55d-4b35-a873-7098bf94a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce28a3c5-f55d-4b35-a873-7098bf94a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1291252676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d88be3-39ca-4e75-991d-7b8c32b7b03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d7c5a31253404a8c9f6cd1e546c863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:56Z,use_quota=True,user_id='eb8a321fca4a4d65b75c0dba46ab099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af808c1-778d-487a-8d87-3504df6335a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af808c1-778d-487a-8d87-3504df6335a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9860164b-eaa8-4937-ace8-b37d39633e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9860164b-eaa8-4937-ace8-b37d39633e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d88be3-39ca-4e75-991d-7b8c32b7b03b', 'volume_name': 'volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa26df9-4fca-45b1-9bdd-e83fe405811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa26df9-4fca-45b1-9bdd-e83fe405811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a57919-55dc-4c62-958e-4fe41e3ebdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b', 'volume_size': 1} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1291252676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d88be3-39ca-4e75-991d-7b8c32b7b03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d7c5a31253404a8c9f6cd1e546c863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:56Z,use_quota=True,user_id='eb8a321fca4a4d65b75c0dba46ab099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Creating volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:56 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:56 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b 1073741824 Nov 04 22:25:56 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:56 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:25:56 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:57 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.472s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:25:57 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b 1073741824" returned: 0 in 0.751s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:57 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b Nov 04 22:25:57 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:58 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b" returned: 0 in 0.746s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (eb699960-4df6-48b4-a157-2e4e36b4ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02069038-bd51-41c0-9cef-99745f48afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02069038-bd51-41c0-9cef-99745f48afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-458141506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f3f53b-68fc-4228-90fc-10730bd38486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:58Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46ceb5f7-71e4-48ed-8cd8-211baa410e95),volume_type_id=46ceb5f7-71e4-48ed-8cd8-211baa410e95)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48b3603-addf-4cc5-a6f3-8071ae8cb246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48b3603-addf-4cc5-a6f3-8071ae8cb246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5e417a-352d-4efc-a5f5-a41fbf8a77cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5e417a-352d-4efc-a5f5-a41fbf8a77cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f3f53b-68fc-4228-90fc-10730bd38486', 'volume_name': 'volume-54f3f53b-68fc-4228-90fc-10730bd38486', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dffa18b-7117-4978-9bc1-47bb58d25eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dffa18b-7117-4978-9bc1-47bb58d25eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaae8dfd-9b11-4fc9-b6ac-aa92d2cabe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume 54f3f53b-68fc-4228-90fc-10730bd38486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f3f53b-68fc-4228-90fc-10730bd38486', 'volume_size': 1} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-458141506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f3f53b-68fc-4228-90fc-10730bd38486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:58Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46ceb5f7-71e4-48ed-8cd8-211baa410e95),volume_type_id=46ceb5f7-71e4-48ed-8cd8-211baa410e95)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Creating volume 54f3f53b-68fc-4228-90fc-10730bd38486 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:58 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a57919-55dc-4c62-958e-4fe41e3ebdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 1073741824 Nov 04 22:25:58 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68744a6d-58d2-4fb7-9c67-09177dd04dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:58 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Volume volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b (76d88be3-39ca-4e75-991d-7b8c32b7b03b): created successfully Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68744a6d-58d2-4fb7-9c67-09177dd04dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (e97cfa3b-d738-49e4-977c-f8d452926ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b88f4b6d-a598-4cf5-a106-e454a6808de6 tempest-VolumesDeleteCascade-2019377649 None] Created volume successfully. Nov 04 22:25:59 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 1073741824" returned: 0 in 0.911s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:59 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 Nov 04 22:25:59 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (276bbe97-840a-4dea-ab46-5c9c9d501f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bc323-c786-4a84-8748-4870e2dbd9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bc323-c786-4a84-8748-4870e2dbd9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1091984982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66a018e-4352-4a55-a677-b9b9ac1b92d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:59Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15e49908-2856-4943-84ab-10f65975e700),volume_type_id=15e49908-2856-4943-84ab-10f65975e700)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f66e32-e3bd-4169-944c-02b6df41236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f66e32-e3bd-4169-944c-02b6df41236f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93b4d1c-d056-4b9c-aa0b-23aca2f85186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93b4d1c-d056-4b9c-aa0b-23aca2f85186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66a018e-4352-4a55-a677-b9b9ac1b92d6', 'volume_name': 'volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc8594c-4a72-413a-91c5-201578d22b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc8594c-4a72-413a-91c5-201578d22b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a3e32d-d1f8-4e6c-b5f9-d2f77c9dbd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume b66a018e-4352-4a55-a677-b9b9ac1b92d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6', 'volume_size': 1} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486" returned: 0 in 0.429s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1091984982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66a018e-4352-4a55-a677-b9b9ac1b92d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:59Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15e49908-2856-4943-84ab-10f65975e700),volume_type_id=15e49908-2856-4943-84ab-10f65975e700)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Creating volume b66a018e-4352-4a55-a677-b9b9ac1b92d6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:25:59 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:25:59 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 1073741824 Nov 04 22:25:59 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Flow 'volume_create_manager' (c6c46aa1-f48e-482f-873f-07119ab752b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac248328-9a23-464d-a200-88535adcf5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac248328-9a23-464d-a200-88535adcf5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1561105343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd9943f-88d7-4a44-9d61-7282fd89e546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd206b35ead4787bea63677847547be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:59Z,use_quota=True,user_id='2f21793e1dd64c788f8a4aab3e4c75ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125dab21-83e3-4330-b70f-429b34a29141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125dab21-83e3-4330-b70f-429b34a29141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db40d2ed-e86f-4752-b92e-dcbd8a2dfb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db40d2ed-e86f-4752-b92e-dcbd8a2dfb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd9943f-88d7-4a44-9d61-7282fd89e546', 'volume_name': 'volume-7fd9943f-88d7-4a44-9d61-7282fd89e546', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c98931-4f8e-446d-ac62-29554136bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:25:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c98931-4f8e-446d-ac62-29554136bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad081cdb-5622-430c-a40b-e77dfacdccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Volume 7fd9943f-88d7-4a44-9d61-7282fd89e546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd9943f-88d7-4a44-9d61-7282fd89e546', 'volume_size': 1} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaae8dfd-9b11-4fc9-b6ac-aa92d2cabe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f3f53b-68fc-4228-90fc-10730bd38486', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0930f3-f17f-4eec-91cc-f91d5b9f4c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume volume-54f3f53b-68fc-4228-90fc-10730bd38486 (54f3f53b-68fc-4228-90fc-10730bd38486): created successfully Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0930f3-f17f-4eec-91cc-f91d5b9f4c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (eb699960-4df6-48b4-a157-2e4e36b4ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ebaedca3-a7c3-4b26-b73b-90e86d88e3b5 tempest-TestInstancesWithCinderVolumes-1423201451 None] Created volume successfully. Nov 04 22:26:00 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 1073741824" returned: 0 in 0.773s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (ddbdb4d4-c278-48a2-8a31-dd973b32e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f342bda7-0d84-480a-b08d-3f9403d4d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f342bda7-0d84-480a-b08d-3f9403d4d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908231470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354c5069-3ba2-4f64-9957-328971d4657f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:01Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60ca8c27-7f71-447b-b255-fce5c4730271),volume_type_id=60ca8c27-7f71-447b-b255-fce5c4730271)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94ae73-de8c-4ee3-b23c-f0336b0f6d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 Nov 04 22:26:00 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94ae73-de8c-4ee3-b23c-f0336b0f6d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ac73ec-78e9-401a-812c-59970a678a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:26:00 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6" returned: 0 in 0.256s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.989s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a3e32d-d1f8-4e6c-b5f9-d2f77c9dbd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf3b45b-18c8-4db4-a6b8-fb6f62a29694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Creating offline snapshot dcdc2916-b656-4627-891b-27ca307461ff of volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 (b66a018e-4352-4a55-a677-b9b9ac1b92d6): created successfully Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf3b45b-18c8-4db4-a6b8-fb6f62a29694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (276bbe97-840a-4dea-ab46-5c9c9d501f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0fd309-b42e-4057-bc0d-8bdda35be28e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ac73ec-78e9-401a-812c-59970a678a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '354c5069-3ba2-4f64-9957-328971d4657f', 'volume_name': 'volume-354c5069-3ba2-4f64-9957-328971d4657f', 'volume_size': 1, 'image_id': '08711014-fe01-4449-adec-1b83499bf36d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--123016763', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b65143642cfe42b2ae3e526796ec5fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08711014-fe01-4449-adec-1b83499bf36d', 'created_at': datetime.datetime(2026, 11, 4, 21, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 25, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08711014-fe01-4449-adec-1b83499bf36d/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bc9c79-5b02-4d39-80e0-0945f2d95c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bc9c79-5b02-4d39-80e0-0945f2d95c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c1bc3-447a-4f57-a499-000b416ba1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume 354c5069-3ba2-4f64-9957-328971d4657f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-354c5069-3ba2-4f64-9957-328971d4657f', 'volume_size': 1, 'image_id': '08711014-fe01-4449-adec-1b83499bf36d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--123016763', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b65143642cfe42b2ae3e526796ec5fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08711014-fe01-4449-adec-1b83499bf36d', 'created_at': datetime.datetime(2026, 11, 4, 21, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 25, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08711014-fe01-4449-adec-1b83499bf36d/file', 'properties': {}}, 'image_service': } Nov 04 22:26:00 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Trying to clone 354c5069-3ba2-4f64-9957-328971d4657f from image 08711014-fe01-4449-adec-1b83499bf36d at location (None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:26:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4374b89a-950e-4578-a6a2-4d194891ae98 tempest-TestInstancesWithCinderVolumes-1423201451 None] Created volume successfully. Nov 04 22:26:01 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b Nov 04 22:26:01 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:01 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b" returned: 0 in 0.482s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:01 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff 1G Nov 04 22:26:01 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:02 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff 1G" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:02 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:02 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:02 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.535s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:02 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff is being set with open permissions: ugo+rw Nov 04 22:26:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:02 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:02 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:03 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:03 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info Nov 04 22:26:03 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:03 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info" returned: 0 in 0.602s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:03 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info is being set with open permissions: ugo+rw Nov 04 22:26:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:03 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info Nov 04 22:26:03 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:04 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.info" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1561105343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd9943f-88d7-4a44-9d61-7282fd89e546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd206b35ead4787bea63677847547be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:25:59Z,use_quota=True,user_id='2f21793e1dd64c788f8a4aab3e4c75ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Creating volume 7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:04 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:04 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 1073741824 Nov 04 22:26:04 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7c15dd5b-179c-4b4a-875f-9fd5de1066dd tempest-VolumesDeleteCascade-2019377649 None] Create snapshot completed successfully Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:04 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 1073741824" returned: 0 in 0.719s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:04 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 Nov 04 22:26:04 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:05 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Creating offline snapshot 506adce7-c890-4e2b-9e12-e7dabc318e8b of volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad081cdb-5622-430c-a40b-e77dfacdccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd9943f-88d7-4a44-9d61-7282fd89e546', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dcc0a-67ef-4c8e-a4c2-0c6f2b505b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[420eabc0-a528-492d-93c0-f1987ab84708]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:05 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Volume volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 (7fd9943f-88d7-4a44-9d61-7282fd89e546): created successfully Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dcc0a-67ef-4c8e-a4c2-0c6f2b505b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Flow 'volume_create_manager' (c6c46aa1-f48e-482f-873f-07119ab752b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3051ff75-ae6a-484a-a019-624762ea6955 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Created volume successfully. Nov 04 22:26:05 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:05 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:05 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.473s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:05 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b 1G Nov 04 22:26:05 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Flow 'volume_create_manager' (4dbda20b-3b64-4d76-9165-2c475c6f2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc5d60-6f5e-4a02-8bff-26b22ac30017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc5d60-6f5e-4a02-8bff-26b22ac30017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2137689024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44a524f-5057-4d4d-8ba0-7fb21ac87e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95212fbf33245538c0611d40ef324ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:06Z,use_quota=True,user_id='f51e85f961fc4a399d6443daed34a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d92a56-1cec-431f-8a40-0268e63a942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d92a56-1cec-431f-8a40-0268e63a942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20816188-4573-4e08-b44c-a6464903c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20816188-4573-4e08-b44c-a6464903c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44a524f-5057-4d4d-8ba0-7fb21ac87e5e', 'volume_name': 'volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd4e2b-f023-4b40-a3c5-b5424d1f24ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd4e2b-f023-4b40-a3c5-b5424d1f24ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a7eade-d847-4c60-93ad-fd96bf495aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:05 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Volume c44a524f-5057-4d4d-8ba0-7fb21ac87e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e', 'volume_size': 1} Nov 04 22:26:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:06 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b 1G" returned: 0 in 0.452s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:06 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b Nov 04 22:26:06 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD, size 20.69 MB, duration 5.16 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:26:06 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Image download 20.69 MB at 4.01 MB/s Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae9b66-6122-4382-8cec-ab46207739a9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:06 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD Nov 04 22:26:06 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:06 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:06 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b is being set with open permissions: ugo+rw Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:06 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b Nov 04 22:26:06 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:06 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Temporary image 08711014-fe01-4449-adec-1b83499bf36d is fetched for user f46cea348bb34063803dd38d60a0d7d6. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759cf47-82d4-46d8-83a1-c618369c977f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:06 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.667s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2137689024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44a524f-5057-4d4d-8ba0-7fb21ac87e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95212fbf33245538c0611d40ef324ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:06Z,use_quota=True,user_id='f51e85f961fc4a399d6443daed34a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Creating volume c44a524f-5057-4d4d-8ba0-7fb21ac87e5e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:06 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:06 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD Nov 04 22:26:06 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:06 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e 1073741824 Nov 04 22:26:06 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f6766d7d-3a8a-4c71-a661-eb06d5072406 tempest-VolumesDeleteCascade-2019377649 None] Create snapshot completed successfully Nov 04 22:26:06 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:07 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e 1073741824" returned: 0 in 0.437s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:07 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e Nov 04 22:26:07 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:07 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.901s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a7eade-d847-4c60-93ad-fd96bf495aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e259a435-57e1-4e9d-b5d7-bdf5098d889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Creating offline snapshot da8e2b70-2917-4d9a-aafa-cd5097102330 of volume 7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:26:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Volume volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e (c44a524f-5057-4d4d-8ba0-7fb21ac87e5e): created successfully Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e259a435-57e1-4e9d-b5d7-bdf5098d889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Flow 'volume_create_manager' (4dbda20b-3b64-4d76-9165-2c475c6f2f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[37942998-ff27-447e-a757-c55ef65aec4e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5a6443ae-6eb6-44e6-b1f9-748b3b3b6826 tempest-ServersNegativeTestJSON-393280620 None] Created volume successfully. Nov 04 22:26:07 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 Nov 04 22:26:07 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-76d88be3-39ca-4e75-991d-7b8c32b7b03b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-76d88be3-39ca-4e75-991d-7b8c32b7b03b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:08 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546" returned: 0 in 0.491s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:08 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 1G Nov 04 22:26:08 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Performing cascade delete. {{(pid=87173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-506adce7-c890-4e2b-9e12-e7dabc318e8b-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-506adce7-c890-4e2b-9e12-e7dabc318e8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-506adce7-c890-4e2b-9e12-e7dabc318e8b" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-506adce7-c890-4e2b-9e12-e7dabc318e8b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Deleting offline snapshot 506adce7-c890-4e2b-9e12-e7dabc318e8b of volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] snapshot_file for this snap is: volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[413543ef-63b3-4870-87d7-56533c193b12]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:08 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b Nov 04 22:26:08 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:08 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 1G" returned: 0 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:08 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 Nov 04 22:26:08 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:08 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b" returned: 0 in 0.414s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[54422fd9-38f5-4276-8f64-6b586c8d6855]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:08 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:08 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:08 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330" returned: 0 in 0.343s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:08 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 is being set with open permissions: ugo+rw Nov 04 22:26:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:08 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 Nov 04 22:26:08 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.479s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:09 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b Nov 04 22:26:09 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Flow 'volume_create_manager' (56440141-67fa-4d09-98f9-c07e6a565503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de12130b-07eb-4eae-be60-55b1c142a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330" returned: 0 in 0.342s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de12130b-07eb-4eae-be60-55b1c142a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1624088513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b587a4-d93e-4934-8842-48630cad2670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95212fbf33245538c0611d40ef324ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:09Z,use_quota=True,user_id='f51e85f961fc4a399d6443daed34a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602f00b4-4f6a-43df-ad9b-5e912d29557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602f00b4-4f6a-43df-ad9b-5e912d29557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdb31c7-cd46-4993-aec4-1234ec8335ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdb31c7-cd46-4993-aec4-1234ec8335ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b587a4-d93e-4934-8842-48630cad2670', 'volume_name': 'volume-16b587a4-d93e-4934-8842-48630cad2670', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8dc8c-a8a0-4dbb-9273-a354fb5eeef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8dc8c-a8a0-4dbb-9273-a354fb5eeef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977c1d36-80dd-4c4f-b7b8-ec48eff3b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Volume 16b587a4-d93e-4934-8842-48630cad2670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b587a4-d93e-4934-8842-48630cad2670', 'volume_size': 1} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:09 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info Nov 04 22:26:09 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b" returned: 0 in 0.376s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:09 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b Nov 04 22:26:09 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info is being set with open permissions: ugo+rw Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:09 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info Nov 04 22:26:09 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.506adce7-c890-4e2b-9e12-e7dabc318e8b" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-506adce7-c890-4e2b-9e12-e7dabc318e8b" released by "_delete_snapshot" :: held 1.666s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" released by "delete_snapshot" :: held 1.697s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:09 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.info" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908231470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354c5069-3ba2-4f64-9957-328971d4657f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65143642cfe42b2ae3e526796ec5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:01Z,use_quota=True,user_id='f46cea348bb34063803dd38d60a0d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60ca8c27-7f71-447b-b255-fce5c4730271),volume_type_id=60ca8c27-7f71-447b-b255-fce5c4730271)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Creating volume 354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:09 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:09 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1073741824 Nov 04 22:26:09 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4bcde5e7-0669-4604-a950-23089e8e67aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Create snapshot completed successfully Nov 04 22:26:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['f19d654a-6049-4ba6-b60b-9e6d511d75d2', '7dd7bcb3-1fad-4b9e-85fa-487eebcd2cd5', '8b813bf3-5390-438b-9f2e-ccc7f040114d', '806fa2eb-a192-4acc-96f8-caf01788d1d1'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Delete snapshot completed successfully. Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-506adce7-c890-4e2b-9e12-e7dabc318e8b-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-dcdc2916-b656-4627-891b-27ca307461ff-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-dcdc2916-b656-4627-891b-27ca307461ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-dcdc2916-b656-4627-891b-27ca307461ff" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-dcdc2916-b656-4627-891b-27ca307461ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Deleting offline snapshot dcdc2916-b656-4627-891b-27ca307461ff of volume 76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] snapshot_file for this snap is: volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5030d2a1-fcdf-48f9-9de5-bfd4bad36eef]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:10 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:10 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:10 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1073741824" returned: 0 in 0.465s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:10 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f Nov 04 22:26:10 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:10 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.392s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb901a8f-657f-4d1d-b3f3-4e4712e38008]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:10 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1624088513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b587a4-d93e-4934-8842-48630cad2670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95212fbf33245538c0611d40ef324ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:09Z,use_quota=True,user_id='f51e85f961fc4a399d6443daed34a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Creating volume 16b587a4-d93e-4934-8842-48630cad2670 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:10 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 1073741824 Nov 04 22:26:10 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Attempting download of 08711014-fe01-4449-adec-1b83499bf36d ((None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}])) to volume 354c5069-3ba2-4f64-9957-328971d4657f. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:26:10 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b Nov 04 22:26:10 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e49d7b-c953-4664-9da9-401dde8ab51d]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:10 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel Nov 04 22:26:10 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b" returned: 0 in 0.417s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:11 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 1073741824" returned: 0 in 0.587s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 Nov 04 22:26:11 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "cinder-da8e2b70-2917-4d9a-aafa-cd5097102330-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-da8e2b70-2917-4d9a-aafa-cd5097102330-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:11 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel Nov 04 22:26:11 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "cinder-quobyte-da8e2b70-2917-4d9a-aafa-cd5097102330" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-da8e2b70-2917-4d9a-aafa-cd5097102330" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Deleting offline snapshot da8e2b70-2917-4d9a-aafa-cd5097102330 of volume 7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] snapshot_file for this snap is: volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[80849446-51ec-4fe4-ba3c-d68b2b2227f8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.470s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff Nov 04 22:26:11 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 Nov 04 22:26:11 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670" returned: 0 in 0.310s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977c1d36-80dd-4c4f-b7b8-ec48eff3b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b587a4-d93e-4934-8842-48630cad2670', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:11 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e33211-76fd-4a0f-8c73-ac5093c06ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel" returned: 1 in 0.448s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08711014-fe01-4449-adec-1b83499bf36d_nr80quel' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e38b72-8c96-4efe-876d-8a68b2408008]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Volume volume-16b587a4-d93e-4934-8842-48630cad2670 (16b587a4-d93e-4934-8842-48630cad2670): created successfully Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e33211-76fd-4a0f-8c73-ac5093c06ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Flow 'volume_create_manager' (56440141-67fa-4d09-98f9-c07e6a565503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-76fc8d4a-d13a-4573-8174-e78ec890c1a8 tempest-ServersNegativeTestJSON-393280620 None] Created volume successfully. Nov 04 22:26:11 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b.dcdc2916-b656-4627-891b-27ca307461ff" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD Nov 04 22:26:11 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-dcdc2916-b656-4627-891b-27ca307461ff" released by "_delete_snapshot" :: held 1.711s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" released by "delete_snapshot" :: held 1.737s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:11 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330" returned: 0 in 0.387s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd9943f-88d7-4a44-9d61-7282fd89e546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94b343-c1dc-4697-84f2-ae5e7be8c93c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['07e257d3-6a2c-41ed-b12f-2dcc7dfbbcd4', 'b3560d24-1eee-47a3-a3da-50ecaa45179e', 'a0d47266-72f0-436c-b359-be58a33fbcaf', 'cc435b14-e77e-4e1f-8222-378a134fa984'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Delete snapshot completed successfully. Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-dcdc2916-b656-4627-891b-27ca307461ff-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Snapshots deleted, issuing volume delete {{(pid=87173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 22:26:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:12 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 Nov 04 22:26:12 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:12 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] 08711014-fe01-4449-adec-1b83499bf36d was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c9e31-772c-4a66-9799-a39a11a2f625]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:12 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f Nov 04 22:26:12 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b Nov 04 22:26:12 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546" returned: 0 in 0.474s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:12 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 Nov 04 22:26:12 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b" returned: 0 in 0.500s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:12 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b Nov 04 22:26:12 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330" returned: 0 in 0.442s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "cinder-16b587a4-d93e-4934-8842-48630cad2670-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:12 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330 Nov 04 22:26:12 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-16b587a4-d93e-4934-8842-48630cad2670-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "cinder-quobyte-16b587a4-d93e-4934-8842-48630cad2670" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:12 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-76d88be3-39ca-4e75-991d-7b8c32b7b03b" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-76d88be3-39ca-4e75-991d-7b8c32b7b03b" released by "delete_volume" :: held 0.950s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-quobyte-16b587a4-d93e-4934-8842-48630cad2670" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea977d95-8841-4e3c-aff0-f90d8be004a5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['449444c9-e305-4157-b0fb-241b1b583740', 'ee8ed6e8-76e7-464e-a963-a3ea0ee5d2c5', 'c05e3f34-5d82-49cd-afd6-c1053b4ef267', 'acf39c2f-0a8f-497d-a759-e22c1f168f68'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:13 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 Nov 04 22:26:13 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:13 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546.da8e2b70-2917-4d9a-aafa-cd5097102330" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:13 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:13 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-da8e2b70-2917-4d9a-aafa-cd5097102330" released by "_delete_snapshot" :: held 1.827s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" released by "delete_snapshot" :: held 1.859s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Created reservations ['6b1bc5bd-38fc-45aa-af4c-b156503c115b', '87f2bc97-52cc-4626-801c-b37fff9303a8', '249d50c7-11be-4ba3-9464-55200189e4a8', 'e908845c-62d4-41be-be43-48276971955e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Delete snapshot completed successfully. Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ed71338-6214-44b6-8818-e5935abe1fe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-da8e2b70-2917-4d9a-aafa-cd5097102330-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:13 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.319s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:13 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670" returned: 0 in 0.484s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Deleted volume successfully. Nov 04 22:26:13 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670 Nov 04 22:26:13 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8a860790-070b-45ab-956f-6c32534ad65f tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-76d88be3-39ca-4e75-991d-7b8c32b7b03b-delete_volume" released by "delete_volume" :: held 5.548s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "cinder-7fd9943f-88d7-4a44-9d61-7282fd89e546-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-7fd9943f-88d7-4a44-9d61-7282fd89e546-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:13 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16b587a4-d93e-4934-8842-48630cad2670" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-quobyte-16b587a4-d93e-4934-8842-48630cad2670" released by "delete_volume" :: held 0.911s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3fba6-e645-4f21-9ce5-289cbf25f753]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Created reservations ['91ccb411-c620-46d1-837b-244fb9eaacae', '1f8565a8-20ea-4b54-8050-92aba32d346e', 'c6fc7de2-78e8-4054-a7dc-15b81e1a90b0', '9594ae8b-830d-4610-b9bd-241f4e7289b6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:14 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 Nov 04 22:26:14 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:14 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:14 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:14 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:14 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546" returned: 0 in 0.487s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Deleted volume successfully. Nov 04 22:26:14 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546 Nov 04 22:26:14 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-64c70843-4885-4c25-a162-6d7988e77f91 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-16b587a4-d93e-4934-8842-48630cad2670-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:14 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f" returned: 0 in 2.455s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08711014-fe01-4449-adec-1b83499bf36d_ak566ujtdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:26:14 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Converted 112.00 MB image at 45.61 MB/s Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:14 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1G Nov 04 22:26:14 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (01069b29-51fb-4813-acba-30d531ac41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8a025c-0d89-4f9e-987c-f45198688f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:14 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8a025c-0d89-4f9e-987c-f45198688f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1495664265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4315dcb3-2d65-4a50-bdde-1b42e2a3bc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d7c5a31253404a8c9f6cd1e546c863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:15Z,use_quota=True,user_id='eb8a321fca4a4d65b75c0dba46ab099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0981d8a-23dc-4360-8648-7818bd023e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0981d8a-23dc-4360-8648-7818bd023e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea9d81-0228-465a-b5d4-52cdf563012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea9d81-0228-465a-b5d4-52cdf563012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4315dcb3-2d65-4a50-bdde-1b42e2a3bc71', 'volume_name': 'volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22ed9c-10ef-4bf3-a946-bbdf998aa17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22ed9c-10ef-4bf3-a946-bbdf998aa17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe0084-c173-441d-8397-d24ac051c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Volume 4315dcb3-2d65-4a50-bdde-1b42e2a3bc71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71', 'volume_size': 1} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1495664265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4315dcb3-2d65-4a50-bdde-1b42e2a3bc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d7c5a31253404a8c9f6cd1e546c863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:15Z,use_quota=True,user_id='eb8a321fca4a4d65b75c0dba46ab099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Creating volume 4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:14 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7fd9943f-88d7-4a44-9d61-7282fd89e546" returned: 0 in 0.381s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:14 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 1073741824 Nov 04 22:26:14 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-quobyte-7fd9943f-88d7-4a44-9d61-7282fd89e546" released by "delete_volume" :: held 0.973s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Created reservations ['cdcc2698-f141-4782-8f70-fa941dda6a58', '0cab910b-57a6-4c62-97e9-88675583211a', '28da8e70-64b9-4947-a697-3b3f0d0caa08', 'e4e75106-be7f-4995-b8e0-620577884b76'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:14 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f 1G" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Downloaded image 08711014-fe01-4449-adec-1b83499bf36d ((None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}])) to volume 354c5069-3ba2-4f64-9957-328971d4657f successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Temporary image 08711014-fe01-4449-adec-1b83499bf36d for user f46cea348bb34063803dd38d60a0d7d6 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Marking volume 354c5069-3ba2-4f64-9957-328971d4657f as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Copying metadata from image 08711014-fe01-4449-adec-1b83499bf36d to 354c5069-3ba2-4f64-9957-328971d4657f. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Creating volume glance metadata for volume 354c5069-3ba2-4f64-9957-328971d4657f backed by image 08711014-fe01-4449-adec-1b83499bf36d with: {'image_id': '08711014-fe01-4449-adec-1b83499bf36d', 'image_name': 'tempest-scenario-img--123016763', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:14 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:14 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c1bc3-447a-4f57-a499-000b416ba1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354c5069-3ba2-4f64-9957-328971d4657f', 'volume_size': 1, 'image_id': '08711014-fe01-4449-adec-1b83499bf36d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08711014-fe01-4449-adec-1b83499bf36d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--123016763', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b65143642cfe42b2ae3e526796ec5fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08711014-fe01-4449-adec-1b83499bf36d', 'created_at': datetime.datetime(2026, 11, 4, 21, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 25, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08711014-fe01-4449-adec-1b83499bf36d/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffe5fb8-0019-4115-b2a2-079969f692bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Volume volume-354c5069-3ba2-4f64-9957-328971d4657f (354c5069-3ba2-4f64-9957-328971d4657f): created successfully Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffe5fb8-0019-4115-b2a2-079969f692bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Flow 'volume_create_manager' (ddbdb4d4-c278-48a2-8a31-dd973b32e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0b629df9-2c1b-4d01-b06e-59eae7df3ef3 tempest-TestInstancesWithCinderVolumes-1423201451 None] Created volume successfully. Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "cinder-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:15 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.303s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "cinder-quobyte-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Deleted volume successfully. Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-quobyte-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1f4b6f1a-f8cf-4c29-96e2-0c073e89b3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1297046856 None] Lock "cinder-7fd9943f-88d7-4a44-9d61-7282fd89e546-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766c32d-2c8b-4d67-8a59-e920e86a060a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:15 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 1073741824" returned: 0 in 0.592s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:15 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:15 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:15 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e Nov 04 22:26:15 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:15 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.262s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe0084-c173-441d-8397-d24ac051c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a1570b-f3be-40f0-8306-74a2f0fa3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Volume volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 (4315dcb3-2d65-4a50-bdde-1b42e2a3bc71): created successfully Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a1570b-f3be-40f0-8306-74a2f0fa3efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (01069b29-51fb-4813-acba-30d531ac41c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:15 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" returned: 0 in 0.382s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a4343887-99a6-4756-a7aa-310523ce8070 tempest-VolumesDeleteCascade-2019377649 None] Created volume successfully. Nov 04 22:26:15 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e Nov 04 22:26:15 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:15 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-quobyte-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e" released by "delete_volume" :: held 0.700s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Created reservations ['e60e89ed-9da0-4e34-920e-cb20cc4a1c03', '7a76da3c-5e11-41fc-8b2d-0553fd963e46', '66baf8d0-8bfd-4185-bc7e-36b852833452', 'eed606f8-10cf-41d1-a432-101fe978c311'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:16 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:16 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:16 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.295s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Deleted volume successfully. Nov 04 22:26:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a066061a-cf92-4bcf-a662-a8f8beeb9649 tempest-ServersNegativeTestJSON-393280620 None] Lock "cinder-c44a524f-5057-4d4d-8ba0-7fb21ac87e5e-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Creating offline snapshot 7fb7befd-f4aa-4de9-8837-2176ac539ccf of volume 4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[025aa6bf-c2c0-441d-b0a0-d9e5aacf35e2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:17 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:17 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:17 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.520s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:17 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf 1G Nov 04 22:26:17 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:18 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf 1G" returned: 0 in 0.705s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:18 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:18 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:19 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.482s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:19 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf is being set with open permissions: ugo+rw Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:19 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:19 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:19 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.500s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-dfe25744-b0e7-42c7-bc4f-0aa276949c63 req-30dd1e84-f03c-4ce4-88ab-0c51de04757d tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:19 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info Nov 04 22:26:19 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:19 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:19 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info is being set with open permissions: ugo+rw Nov 04 22:26:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:20 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info Nov 04 22:26:20 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:20 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.info" returned: 0 in 0.320s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-dfe25744-b0e7-42c7-bc4f-0aa276949c63 req-30dd1e84-f03c-4ce4-88ab-0c51de04757d tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.773s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-dfe25744-b0e7-42c7-bc4f-0aa276949c63 req-30dd1e84-f03c-4ce4-88ab-0c51de04757d tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-70a5a1ec-3d48-4c28-82c0-0a94587161fe tempest-VolumesDeleteCascade-2019377649 None] Create snapshot completed successfully Nov 04 22:26:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-dfe25744-b0e7-42c7-bc4f-0aa276949c63 req-30dd1e84-f03c-4ce4-88ab-0c51de04757d tempest-TestInstancesWithCinderVolumes-1423201451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-354c5069-3ba2-4f64-9957-328971d4657f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9fb9526-23e1-4c8f-87b4-265aef0d167b', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:26:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-dfe25744-b0e7-42c7-bc4f-0aa276949c63 req-30dd1e84-f03c-4ce4-88ab-0c51de04757d tempest-TestInstancesWithCinderVolumes-1423201451 None] attachment_update completed successfully. Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (f8a5a3ad-58e7-4e5e-bf96-bed718a6a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3625e30e-21ee-4174-b502-9dc843660d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3625e30e-21ee-4174-b502-9dc843660d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-187806036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fd492b-b4ab-432a-b096-f7b314bfe7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d7c5a31253404a8c9f6cd1e546c863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7fb7befd-f4aa-4de9-8837-2176ac539ccf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:22Z,use_quota=True,user_id='eb8a321fca4a4d65b75c0dba46ab099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa313df-8d4d-406e-b30f-0b8d2b589a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa313df-8d4d-406e-b30f-0b8d2b589a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501a09c0-1367-4fbd-a7b8-45b7a7775702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501a09c0-1367-4fbd-a7b8-45b7a7775702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53fd492b-b4ab-432a-b096-f7b314bfe7a0', 'volume_name': 'volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0', 'volume_size': 1, 'snapshot_id': '7fb7befd-f4aa-4de9-8837-2176ac539ccf'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c52fc41-9d1a-4df0-ad59-1094858cd423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c52fc41-9d1a-4df0-ad59-1094858cd423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ec5c8-ea94-4a70-a188-a63fab9b450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Volume 53fd492b-b4ab-432a-b096-f7b314bfe7a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0', 'volume_size': 1, 'snapshot_id': '7fb7befd-f4aa-4de9-8837-2176ac539ccf'} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf-53fd492b-b4ab-432a-b096-f7b314bfe7a0" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf-53fd492b-b4ab-432a-b096-f7b314bfe7a0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Creating volume 53fd492b-b4ab-432a-b096-f7b314bfe7a0 from snapshot 7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] snapshot: 7fb7befd-f4aa-4de9-8837-2176ac539ccf, volume: 53fd492b-b4ab-432a-b096-f7b314bfe7a0, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b5ad9-e7a5-4b95-ad1e-1214fe197176]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:22 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:22 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:22 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.448s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b16936-dda5-4342-884a-bacfa8ece3a0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:23 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:23 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:23 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.707s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:26:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:26:23 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:26:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:23 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 Nov 04 22:26:23 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=77,cinder:SELECT=82,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:26:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=76,cinder:UPDATE=86,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:26:35 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0" returned: 0 in 12.424s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71, size 1024.00 MB, duration 12.43 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:26:36 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Converted 1024.00 MB image at 82.41 MB/s Nov 04 22:26:36 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 is being set with open permissions: ugo+rw Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:36 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 Nov 04 22:26:36 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:36 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" released by "_copy_volume_from_snapshot" :: held 14.173s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf-53fd492b-b4ab-432a-b096-f7b314bfe7a0" released by "_create_volume_from_snapshot" :: held 14.288s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.307s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ec5c8-ea94-4a70-a188-a63fab9b450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0', 'volume_size': 1, 'snapshot_id': '7fb7befd-f4aa-4de9-8837-2176ac539ccf'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e020d-cac3-4439-82d6-798abf2c651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:36 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Volume volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 (53fd492b-b4ab-432a-b096-f7b314bfe7a0): created successfully Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e020d-cac3-4439-82d6-798abf2c651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Flow 'volume_create_manager' (f8a5a3ad-58e7-4e5e-bf96-bed718a6a55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:36 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-afc2bf33-1d95-4a8c-85b8-a924fd01b8d8 tempest-VolumesDeleteCascade-2019377649 None] Created volume successfully. Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Performing cascade delete. {{(pid=87173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-7fb7befd-f4aa-4de9-8837-2176ac539ccf-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-7fb7befd-f4aa-4de9-8837-2176ac539ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Deleting offline snapshot 7fb7befd-f4aa-4de9-8837-2176ac539ccf of volume 4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] snapshot_file for this snap is: volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e9aa5-147e-4f71-bf3c-e38ab7ddfb48]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:37 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:37 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:38 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.495s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2b87d-18c9-4002-9bff-11487aa45eb1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:38 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:38 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:39 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.794s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:39 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:39 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:39 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.845s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:40 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf Nov 04 22:26:40 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:40 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71.7fb7befd-f4aa-4de9-8837-2176ac539ccf" returned: 0 in 0.350s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-7fb7befd-f4aa-4de9-8837-2176ac539ccf" released by "_delete_snapshot" :: held 2.645s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" released by "delete_snapshot" :: held 2.684s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['ca37c5cb-6c26-407c-bd50-bb5c47fa4092', '461007c0-9652-4cc5-a531-c453e6e78d7a', '5b89f40f-ad21-496b-adc5-4f443d964c4b', '28872a4a-c3c6-42b3-bfcb-7c7d5201cf8c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Delete snapshot completed successfully. Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-7fb7befd-f4aa-4de9-8837-2176ac539ccf-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Snapshots deleted, issuing volume delete {{(pid=87173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f183c67-f7b7-4e72-8044-53bae54b664e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:40 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:40 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:41 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.797s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:41 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71 Nov 04 22:26:41 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:41 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" returned: 0 in 0.442s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71" released by "delete_volume" :: held 1.324s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['6e5e7495-5514-4ab7-ade1-56d7fa62688e', 'a0018352-9a26-4d0d-a19e-1c0a3812d722', 'e2075f8d-4e9a-4422-92fa-ddd1aca482a7', 'b2825723-26c8-44c8-a2b4-cac42de7df87'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:42 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:42 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:42 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Deleted volume successfully. Nov 04 22:26:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d9681160-4092-40c4-8479-4406ceda18ca tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-4315dcb3-2d65-4a50-bdde-1b42e2a3bc71-delete_volume" released by "delete_volume" :: held 5.076s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-53fd492b-b4ab-432a-b096-f7b314bfe7a0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-53fd492b-b4ab-432a-b096-f7b314bfe7a0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" acquired by "delete_volume" :: waited 0.039s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ba295-1119-4dbf-baab-871948398d0a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:43 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 Nov 04 22:26:43 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Flow 'volume_create_manager' (18180570-177e-4bcc-be0c-8d59ac10e470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af153f05-261b-4c94-91e4-d96ab73ce2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af153f05-261b-4c94-91e4-d96ab73ce2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1575337678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6773b288-7835-4834-91c9-57e8ad108dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c1a1ac5069498b8fbd064463051ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:44Z,use_quota=True,user_id='f08d36cce66c4e7d8ae90d34f074c999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ad1da-c9e3-4fc3-afe7-d96af7278aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ad1da-c9e3-4fc3-afe7-d96af7278aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a82c8b-7183-49dd-a88e-06a2df5863e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a82c8b-7183-49dd-a88e-06a2df5863e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6773b288-7835-4834-91c9-57e8ad108dd2', 'volume_name': 'volume-6773b288-7835-4834-91c9-57e8ad108dd2', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30bf024-1c82-44b9-8480-cfebda5d2c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30bf024-1c82-44b9-8480-cfebda5d2c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d99e621-d030-4a79-bc4b-fa12813d3fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Volume 6773b288-7835-4834-91c9-57e8ad108dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6773b288-7835-4834-91c9-57e8ad108dd2', 'volume_size': 1} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1575337678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6773b288-7835-4834-91c9-57e8ad108dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c1a1ac5069498b8fbd064463051ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:44Z,use_quota=True,user_id='f08d36cce66c4e7d8ae90d34f074c999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Creating volume 6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:44 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:44 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 1073741824 Nov 04 22:26:44 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:44 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0" returned: 0 in 0.599s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:44 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0 Nov 04 22:26:44 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:44 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-53fd492b-b4ab-432a-b096-f7b314bfe7a0" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-quobyte-53fd492b-b4ab-432a-b096-f7b314bfe7a0" released by "delete_volume" :: held 1.079s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:44 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Created reservations ['26a4009b-dee5-4e6b-ba62-2c35c5ef6f5b', '0284e43d-a26e-46c6-8cba-e6153231a76f', 'b33cb01f-e512-40d6-a2f9-69717dd9012e', '5e87d8fe-daf8-451d-9df9-d39b151ba89a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:45 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:45 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:45 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 1073741824" returned: 0 in 0.762s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:45 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 Nov 04 22:26:45 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:45 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.425s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Deleted volume successfully. Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b98d2b36-f898-4342-806e-64d5251e7df9 tempest-VolumesDeleteCascade-2019377649 None] Lock "cinder-53fd492b-b4ab-432a-b096-f7b314bfe7a0-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:45 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2" returned: 0 in 0.347s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d99e621-d030-4a79-bc4b-fa12813d3fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6773b288-7835-4834-91c9-57e8ad108dd2', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f417ac76-2b71-4b0a-8188-175bddb9028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Volume volume-6773b288-7835-4834-91c9-57e8ad108dd2 (6773b288-7835-4834-91c9-57e8ad108dd2): created successfully Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f417ac76-2b71-4b0a-8188-175bddb9028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Flow 'volume_create_manager' (18180570-177e-4bcc-be0c-8d59ac10e470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a9988a68-b8e7-4297-a59e-91f4cace83b9 tempest-SnapshotMetadataTestJSON-1260286910 None] Created volume successfully. Nov 04 22:26:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Creating offline snapshot 754cb4c6-5ade-45ed-bb93-291d35194d2d of volume 6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:26:46 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b3551a-4c2e-49b6-a608-22524733ab6e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:46 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 Nov 04 22:26:46 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:47 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2" returned: 0 in 0.431s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:47 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d 1G Nov 04 22:26:47 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:47 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d 1G" returned: 0 in 0.544s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6773b288-7835-4834-91c9-57e8ad108dd2 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:47 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6773b288-7835-4834-91c9-57e8ad108dd2 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d Nov 04 22:26:47 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:48 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6773b288-7835-4834-91c9-57e8ad108dd2 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:48 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d is being set with open permissions: ugo+rw Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:48 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d Nov 04 22:26:48 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:48 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d" returned: 0 in 0.287s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:48 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info Nov 04 22:26:48 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:48 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info" returned: 0 in 0.341s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:48 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info is being set with open permissions: ugo+rw Nov 04 22:26:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:48 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info Nov 04 22:26:48 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:49 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.info" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8bfe59d4-9da0-4b65-8d24-ff4aea9c0c93 tempest-SnapshotMetadataTestJSON-1260286910 None] Create snapshot completed successfully Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Flow 'volume_create_manager' (d7e973bc-4e93-40ec-bcf1-feb7e56d1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ab8e48-e8a5-4de1-8f7a-1e274120d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ab8e48-e8a5-4de1-8f7a-1e274120d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-556067125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acad0cb2-f799-4c73-8031-b63bd6005825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28614d8ee6bb4a478d4a3f536c6b69fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:51Z,use_quota=True,user_id='171876f03685435294b6e832e6c082a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a4ddeb-4d70-4cd1-a292-7483a15ec93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a4ddeb-4d70-4cd1-a292-7483a15ec93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe729f7-28e5-4600-abb9-b646ebb25382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe729f7-28e5-4600-abb9-b646ebb25382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acad0cb2-f799-4c73-8031-b63bd6005825', 'volume_name': 'volume-acad0cb2-f799-4c73-8031-b63bd6005825', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8dadb7-391b-40df-bb65-e56af58b9426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8dadb7-391b-40df-bb65-e56af58b9426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefffb12-7408-4fad-91bb-e06f2a7cb8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Volume acad0cb2-f799-4c73-8031-b63bd6005825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acad0cb2-f799-4c73-8031-b63bd6005825', 'volume_size': 1} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-556067125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acad0cb2-f799-4c73-8031-b63bd6005825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28614d8ee6bb4a478d4a3f536c6b69fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:26:51Z,use_quota=True,user_id='171876f03685435294b6e832e6c082a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Creating volume acad0cb2-f799-4c73-8031-b63bd6005825 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:26:50 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "cinder-754cb4c6-5ade-45ed-bb93-291d35194d2d-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:50 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 1073741824 Nov 04 22:26:50 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-754cb4c6-5ade-45ed-bb93-291d35194d2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "cinder-quobyte-754cb4c6-5ade-45ed-bb93-291d35194d2d" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-754cb4c6-5ade-45ed-bb93-291d35194d2d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Deleting offline snapshot 754cb4c6-5ade-45ed-bb93-291d35194d2d of volume 6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] snapshot_file for this snap is: volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ca706-928e-4591-b751-4ff791417a40]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:51 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d Nov 04 22:26:51 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:51 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 1073741824" returned: 0 in 0.550s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:51 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6773b288-7835-4834-91c9-57e8ad108dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc41e75-bb29-41e5-a51c-ae2c56267bfb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:51 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 Nov 04 22:26:51 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:51 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 Nov 04 22:26:51 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:51 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825" returned: 0 in 0.357s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefffb12-7408-4fad-91bb-e06f2a7cb8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acad0cb2-f799-4c73-8031-b63bd6005825', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bcdc00-ec1b-46db-ba9a-0a8aaccb840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:26:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Volume volume-acad0cb2-f799-4c73-8031-b63bd6005825 (acad0cb2-f799-4c73-8031-b63bd6005825): created successfully Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bcdc00-ec1b-46db-ba9a-0a8aaccb840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Flow 'volume_create_manager' (d7e973bc-4e93-40ec-bcf1-feb7e56d1962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:26:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b4453b56-54de-4441-8051-6b9a5c55d0a6 tempest-VolumesMetadataTest-1940231570 None] Created volume successfully. Nov 04 22:26:51 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2" returned: 0 in 0.501s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:51 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d Nov 04 22:26:51 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:52 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:52 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d Nov 04 22:26:52 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:52 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2.754cb4c6-5ade-45ed-bb93-291d35194d2d" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-754cb4c6-5ade-45ed-bb93-291d35194d2d" released by "_delete_snapshot" :: held 1.727s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" released by "delete_snapshot" :: held 1.759s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Created reservations ['9b491d8d-b16c-4b49-bb4e-274ba7ac846e', '1e45042b-95b0-477b-9913-153ecf935625', 'b0d930b4-3c4f-44f6-aa36-6a3f8fc61b4e', '1c043b0b-ada3-4e79-8c23-653f03d87648'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Delete snapshot completed successfully. Nov 04 22:26:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-53d5fc5d-ecf5-417b-90f1-95ce1128cebc tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-754cb4c6-5ade-45ed-bb93-291d35194d2d-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "cinder-6773b288-7835-4834-91c9-57e8ad108dd2-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-6773b288-7835-4834-91c9-57e8ad108dd2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" acquired by "delete_volume" :: waited 0.040s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1af751-238c-4ef6-b3d1-d8dfc906e2cc]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:53 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 Nov 04 22:26:53 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Acquiring lock "cinder-acad0cb2-f799-4c73-8031-b63bd6005825-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "cinder-acad0cb2-f799-4c73-8031-b63bd6005825-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Acquiring lock "cinder-quobyte-acad0cb2-f799-4c73-8031-b63bd6005825" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "cinder-quobyte-acad0cb2-f799-4c73-8031-b63bd6005825" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6fe3ec-cf30-4b39-b0af-173db94963d3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:26:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:54 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2" returned: 0 in 0.647s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:54 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2 Nov 04 22:26:54 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:54 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 Nov 04 22:26:54 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:54 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6773b288-7835-4834-91c9-57e8ad108dd2" returned: 0 in 0.505s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-quobyte-6773b288-7835-4834-91c9-57e8ad108dd2" released by "delete_volume" :: held 1.284s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:54 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825" returned: 0 in 0.650s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:54 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825 Nov 04 22:26:54 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Created reservations ['54cf6204-1c0c-4bd8-8c84-ffc2daca530d', 'c93ad09b-aab6-473e-97f1-8fe11d0c8d03', '5920eadf-ba8b-4c35-bb75-0408479c8e36', '41fdaeca-160e-4926-8d2b-28e23a208e2e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:54 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:54 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:54 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-acad0cb2-f799-4c73-8031-b63bd6005825" returned: 0 in 0.311s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "cinder-quobyte-acad0cb2-f799-4c73-8031-b63bd6005825" released by "delete_volume" :: held 1.036s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Created reservations ['7564712c-a603-4eef-a139-e9343af775e7', '4a0fff4b-c144-47b3-945a-06fc7807e387', '7cbac625-6981-4ef7-8468-b6a5e0e6c175', '0eeeb51f-ea4a-410b-b6cd-b5c7c9dc408c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:55 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.389s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Deleted volume successfully. Nov 04 22:26:55 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:55 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-920dab4b-5ecd-4506-89a2-c5bb8efc9d8c tempest-SnapshotMetadataTestJSON-1260286910 None] Lock "cinder-6773b288-7835-4834-91c9-57e8ad108dd2-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:55 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.298s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Deleted volume successfully. Nov 04 22:26:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8b654572-c502-44f9-b978-c037b500422a tempest-VolumesMetadataTest-1940231570 None] Lock "cinder-acad0cb2-f799-4c73-8031-b63bd6005825-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:26:56 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:26:56 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:26:57 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.410s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-27d9d376-7d2c-4714-9b31-4fe7e2bae5a7 req-d9ec309e-ab9a-4c7f-a938-a000e43349a7 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-27d9d376-7d2c-4714-9b31-4fe7e2bae5a7 req-d9ec309e-ab9a-4c7f-a938-a000e43349a7 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-27d9d376-7d2c-4714-9b31-4fe7e2bae5a7 req-d9ec309e-ab9a-4c7f-a938-a000e43349a7 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:26:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-27d9d376-7d2c-4714-9b31-4fe7e2bae5a7 req-d9ec309e-ab9a-4c7f-a938-a000e43349a7 tempest-TestInstancesWithCinderVolumes-1423201451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-54f3f53b-68fc-4228-90fc-10730bd38486', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76d1dd31-dba3-4f1e-afe5-3c8e5d24fdf5', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:26:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-27d9d376-7d2c-4714-9b31-4fe7e2bae5a7 req-d9ec309e-ab9a-4c7f-a938-a000e43349a7 tempest-TestInstancesWithCinderVolumes-1423201451 None] attachment_update completed successfully. Nov 04 22:27:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-3be4e65c-cc45-4abe-a862-44f191681e1b req-694b1f22-0af6-4818-812f-00f17a208e9d tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-3be4e65c-cc45-4abe-a862-44f191681e1b req-694b1f22-0af6-4818-812f-00f17a208e9d tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-3be4e65c-cc45-4abe-a862-44f191681e1b req-694b1f22-0af6-4818-812f-00f17a208e9d tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-3be4e65c-cc45-4abe-a862-44f191681e1b req-694b1f22-0af6-4818-812f-00f17a208e9d tempest-TestInstancesWithCinderVolumes-1423201451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ff36d75-1106-457d-9de8-6b81b35e229a', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:27:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-3be4e65c-cc45-4abe-a862-44f191681e1b req-694b1f22-0af6-4818-812f-00f17a208e9d tempest-TestInstancesWithCinderVolumes-1423201451 None] attachment_update completed successfully. Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Flow 'volume_create_manager' (35afa288-5282-4191-893b-4e61a0fb822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53a4aa-77f1-48b6-82e3-57717f008933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53a4aa-77f1-48b6-82e3-57717f008933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-198321007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d983a7b-e157-459f-9c30-a86982bdca2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26edd9581e404173aa190b37ee4b2d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:05Z,use_quota=True,user_id='a1e7fc4d4e4f410cbd1c60235c96e396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5532f1cb-3d65-4245-972a-692fad04411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5532f1cb-3d65-4245-972a-692fad04411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e73388-fd56-4256-947a-14bde07762ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e73388-fd56-4256-947a-14bde07762ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d983a7b-e157-459f-9c30-a86982bdca2a', 'volume_name': 'volume-5d983a7b-e157-459f-9c30-a86982bdca2a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ebc925-2e03-47f1-836f-0eee494df562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ebc925-2e03-47f1-836f-0eee494df562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105f211-09b7-4e88-86e1-20cdf31b795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:04 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Volume 5d983a7b-e157-459f-9c30-a86982bdca2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d983a7b-e157-459f-9c30-a86982bdca2a', 'volume_size': 1} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-198321007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d983a7b-e157-459f-9c30-a86982bdca2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26edd9581e404173aa190b37ee4b2d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:05Z,use_quota=True,user_id='a1e7fc4d4e4f410cbd1c60235c96e396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Creating volume 5d983a7b-e157-459f-9c30-a86982bdca2a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:04 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:04 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a 1073741824 Nov 04 22:27:04 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:05 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a 1073741824" returned: 0 in 0.621s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:05 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a Nov 04 22:27:05 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:06 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a" returned: 0 in 0.606s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105f211-09b7-4e88-86e1-20cdf31b795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d983a7b-e157-459f-9c30-a86982bdca2a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b6255-d2b5-4065-82d6-b23b621ba55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Volume volume-5d983a7b-e157-459f-9c30-a86982bdca2a (5d983a7b-e157-459f-9c30-a86982bdca2a): created successfully Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b6255-d2b5-4065-82d6-b23b621ba55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Flow 'volume_create_manager' (35afa288-5282-4191-893b-4e61a0fb822a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2c3542c7-3094-4487-bf7c-29f03bf7b6c0 tempest-VolumesTransfersV355Test-1693245116 None] Created volume successfully. Nov 04 22:27:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-8773dc3d-305d-4c30-8208-d259ed88b391 req-e575090d-f49e-4835-8e9e-40c45f55a0df tempest-TestInstancesWithCinderVolumes-1423201451 None] Terminate volume connection completed successfully. Nov 04 22:27:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-8773dc3d-305d-4c30-8208-d259ed88b391 req-e575090d-f49e-4835-8e9e-40c45f55a0df tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleting attachment 76d1dd31-dba3-4f1e-afe5-3c8e5d24fdf5. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:27:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-53348656-15ab-41c6-b085-09f8a4861202 tempest-VolumesTransfersV355Test-1226651163 None] Transfer volume completed successfully. Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-54f3f53b-68fc-4228-90fc-10730bd38486-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-54f3f53b-68fc-4228-90fc-10730bd38486-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-quobyte-54f3f53b-68fc-4228-90fc-10730bd38486" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-54f3f53b-68fc-4228-90fc-10730bd38486" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec85105-ca7d-452a-be2b-b02fa23f27a1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:09 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 Nov 04 22:27:09 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "cinder-5d983a7b-e157-459f-9c30-a86982bdca2a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-5d983a7b-e157-459f-9c30-a86982bdca2a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "cinder-quobyte-5d983a7b-e157-459f-9c30-a86982bdca2a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:09 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-quobyte-5d983a7b-e157-459f-9c30-a86982bdca2a" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486" returned: 0 in 0.669s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c19738-80e5-4229-9ce5-e8bbdf0da1cf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:10 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486 Nov 04 22:27:10 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:10 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a Nov 04 22:27:10 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:10 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54f3f53b-68fc-4228-90fc-10730bd38486" returned: 0 in 0.635s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-54f3f53b-68fc-4228-90fc-10730bd38486" released by "delete_volume" :: held 1.416s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:10 devstack cinder-volume[87173]: WARNING cinder.quota [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834200885-1958497043 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834200885-1958497043, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:10 devstack cinder-volume[87173]: WARNING cinder.quota [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834200885-1958497043 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834200885-1958497043, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Created reservations ['2a13dd98-00fd-4a58-b344-acd4f4e11825', '601ee9e0-a918-425e-91df-7b63bc4f35a9', 'e365feee-ffbb-403e-a096-6696f5f19a8a', 'fbbc784c-4ea9-4a7a-81a6-11455d066269'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:10 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a" returned: 0 in 0.974s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:11 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a Nov 04 22:27:11 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:11 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:11 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:11 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5d983a7b-e157-459f-9c30-a86982bdca2a" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-quobyte-5d983a7b-e157-459f-9c30-a86982bdca2a" released by "delete_volume" :: held 1.500s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Created reservations ['206eee37-2f50-4392-b956-d07be5d9c198', 'cbe0ba10-4d93-4ed4-990e-f268fdf9e57b', '81bddde9-1547-405f-b0e1-e1bcd1960393', '18423837-e7d7-4888-9659-7c7b81545f0b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:11 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.562s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleted volume successfully. Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2603411b-005e-408e-a21f-2d8c4a922523 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-54f3f53b-68fc-4228-90fc-10730bd38486-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:11 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:11 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:12 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.334s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:12 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Deleted volume successfully. Nov 04 22:27:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1245b12b-94fb-4b07-8e3d-f3cc5306a425 tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-5d983a7b-e157-459f-9c30-a86982bdca2a-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Flow 'volume_create_manager' (8dc95983-3b64-4c24-8022-913b5bc668c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3126b14c-57e7-45ad-bfd1-679cc775bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3126b14c-57e7-45ad-bfd1-679cc775bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2050947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db024cda-b215-4494-87ff-fb9b06567f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26edd9581e404173aa190b37ee4b2d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:13Z,use_quota=True,user_id='a1e7fc4d4e4f410cbd1c60235c96e396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e032dd5-0ac0-46c7-956b-250147276830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e032dd5-0ac0-46c7-956b-250147276830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57642f01-dd45-47a4-8c8b-cea03b55fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57642f01-dd45-47a4-8c8b-cea03b55fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db024cda-b215-4494-87ff-fb9b06567f70', 'volume_name': 'volume-db024cda-b215-4494-87ff-fb9b06567f70', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e619770e-0cf7-4270-a26b-9630f8adb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e619770e-0cf7-4270-a26b-9630f8adb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19606cd9-fd66-43ea-9534-cace72c6ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:13 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Volume db024cda-b215-4494-87ff-fb9b06567f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db024cda-b215-4494-87ff-fb9b06567f70', 'volume_size': 1} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2050947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db024cda-b215-4494-87ff-fb9b06567f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26edd9581e404173aa190b37ee4b2d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:13Z,use_quota=True,user_id='a1e7fc4d4e4f410cbd1c60235c96e396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Creating volume db024cda-b215-4494-87ff-fb9b06567f70 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:13 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:13 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 1073741824 Nov 04 22:27:13 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:13 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 1073741824" returned: 0 in 0.596s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:14 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 Nov 04 22:27:14 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:14 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70" returned: 0 in 0.704s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19606cd9-fd66-43ea-9534-cace72c6ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db024cda-b215-4494-87ff-fb9b06567f70', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b39a24-f74f-4263-ac32-4a24d71e11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Volume volume-db024cda-b215-4494-87ff-fb9b06567f70 (db024cda-b215-4494-87ff-fb9b06567f70): created successfully Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b39a24-f74f-4263-ac32-4a24d71e11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Flow 'volume_create_manager' (8dc95983-3b64-4c24-8022-913b5bc668c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c39bf1a7-8b11-4e84-b847-6abe164278c8 tempest-VolumesTransfersV355Test-1693245116 None] Created volume successfully. Nov 04 22:27:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-758e76eb-725f-474f-8ff6-d4d7d34061ae req-f5976ac4-d7e5-4283-8e39-1018ccd9a96e tempest-TestInstancesWithCinderVolumes-1423201451 None] Terminate volume connection completed successfully. Nov 04 22:27:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-758e76eb-725f-474f-8ff6-d4d7d34061ae req-f5976ac4-d7e5-4283-8e39-1018ccd9a96e tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleting attachment 7ff36d75-1106-457d-9de8-6b81b35e229a. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-b66a018e-4352-4a55-a677-b9b9ac1b92d6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-b66a018e-4352-4a55-a677-b9b9ac1b92d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-quobyte-b66a018e-4352-4a55-a677-b9b9ac1b92d6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-b66a018e-4352-4a55-a677-b9b9ac1b92d6" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "cinder-db024cda-b215-4494-87ff-fb9b06567f70-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee94d33-c995-4e04-97e0-7e38bea819d5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-db024cda-b215-4494-87ff-fb9b06567f70-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "cinder-quobyte-db024cda-b215-4494-87ff-fb9b06567f70" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-quobyte-db024cda-b215-4494-87ff-fb9b06567f70" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:16 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 Nov 04 22:27:16 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b1aa80-fe98-4ea9-879e-3f8fa2c62312]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:16 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 Nov 04 22:27:16 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:16 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6" returned: 0 in 0.707s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:16 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6 Nov 04 22:27:16 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:16 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70" returned: 0 in 0.638s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:16 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70 Nov 04 22:27:16 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:17 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b66a018e-4352-4a55-a677-b9b9ac1b92d6" returned: 0 in 0.470s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-b66a018e-4352-4a55-a677-b9b9ac1b92d6" released by "delete_volume" :: held 1.329s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:17 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-db024cda-b215-4494-87ff-fb9b06567f70" returned: 0 in 0.358s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-quobyte-db024cda-b215-4494-87ff-fb9b06567f70" released by "delete_volume" :: held 1.109s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:17 devstack cinder-volume[87173]: WARNING cinder.quota [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206773711-38054088 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206773711-38054088, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:17 devstack cinder-volume[87173]: WARNING cinder.quota [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206773711-38054088 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206773711-38054088, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Created reservations ['8fbcb83a-1945-45cf-a29e-a6c9d6ee2269', 'c33625d9-4371-435c-a39c-32ce25a1c82c', '6a4c3842-8d6e-4efb-878e-b0b431598593', '6a976a3b-9aeb-4f05-9637-f8262255f283'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Created reservations ['c9465d31-5c66-4556-afa2-6f7ba669566d', 'b3c583bd-3891-48d0-a822-b2ef62485840', '83ec4132-b289-4a47-9ecc-057528567e7f', '21ccb82f-3fd5-46ce-82b3-a002d212024f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:17 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:17 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:17 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:17 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:17 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.334s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleted volume successfully. Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7bdc91e-6743-4ec0-a3bf-e30e5dc759f9 tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-b66a018e-4352-4a55-a677-b9b9ac1b92d6-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:17 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.466s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Deleted volume successfully. Nov 04 22:27:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e570de4b-31ed-4aad-a23a-66c85f33eecc tempest-VolumesTransfersV355Test-459067604 None] Lock "cinder-db024cda-b215-4494-87ff-fb9b06567f70-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Flow 'volume_create_manager' (487cd0f0-63a8-42bd-af6b-350ade2504cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f21264-f11e-4c36-b32a-1d5d797529d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f21264-f11e-4c36-b32a-1d5d797529d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489047251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f22d51-8a64-4498-84cd-d3362f5cf005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ef1ae40ef54485bb3a97a191d4d51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:24Z,use_quota=True,user_id='19a7ba1937154ffe89c9c3c6a12ff19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784026d6-1eca-451c-9d08-e8c0f21ea13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784026d6-1eca-451c-9d08-e8c0f21ea13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f08caf-aadd-475f-bcdf-d525fb6d92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f08caf-aadd-475f-bcdf-d525fb6d92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f22d51-8a64-4498-84cd-d3362f5cf005', 'volume_name': 'volume-a0f22d51-8a64-4498-84cd-d3362f5cf005', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98399f92-a059-49b0-8d6f-5474cab74e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98399f92-a059-49b0-8d6f-5474cab74e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476a642-9856-480f-8bdc-d0f84dfbb68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Volume a0f22d51-8a64-4498-84cd-d3362f5cf005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f22d51-8a64-4498-84cd-d3362f5cf005', 'volume_size': 1} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489047251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f22d51-8a64-4498-84cd-d3362f5cf005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ef1ae40ef54485bb3a97a191d4d51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:24Z,use_quota=True,user_id='19a7ba1937154ffe89c9c3c6a12ff19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Creating volume a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:23 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:23 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 1073741824 Nov 04 22:27:23 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-a3f43f77-c011-41a1-be70-7383fb53d1dd req-81c81704-6b1f-4a62-94b0-e7967108e669 tempest-TestInstancesWithCinderVolumes-1423201451 None] Terminate volume connection completed successfully. Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a3f43f77-c011-41a1-be70-7383fb53d1dd req-81c81704-6b1f-4a62-94b0-e7967108e669 tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleting attachment a9fb9526-23e1-4c8f-87b4-265aef0d167b. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:27:24 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 1073741824" returned: 0 in 0.574s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:24 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:27:24 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:24 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.281s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476a642-9856-480f-8bdc-d0f84dfbb68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f22d51-8a64-4498-84cd-d3362f5cf005', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a0b0e0-13bd-4655-923b-e7d062e79bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Volume volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 (a0f22d51-8a64-4498-84cd-d3362f5cf005): created successfully Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a0b0e0-13bd-4655-923b-e7d062e79bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Flow 'volume_create_manager' (487cd0f0-63a8-42bd-af6b-350ade2504cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-63e06b63-e644-420a-896a-4182f3b0b84d tempest-VolumesActionsTest-1022292081 None] Created volume successfully. Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-354c5069-3ba2-4f64-9957-328971d4657f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-354c5069-3ba2-4f64-9957-328971d4657f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "cinder-quobyte-354c5069-3ba2-4f64-9957-328971d4657f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-354c5069-3ba2-4f64-9957-328971d4657f" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8fb292-72ad-4e0b-8cbb-b1e84be9a7d6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:25 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f Nov 04 22:27:25 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:25 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f" returned: 0 in 0.367s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:25 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f Nov 04 22:27:25 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:25 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-354c5069-3ba2-4f64-9957-328971d4657f" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-quobyte-354c5069-3ba2-4f64-9957-328971d4657f" released by "delete_volume" :: held 0.709s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:26 devstack cinder-volume[87173]: WARNING cinder.quota [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958428376-1299984243 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958428376-1299984243, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:26 devstack cinder-volume[87173]: WARNING cinder.quota [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958428376-1299984243 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958428376-1299984243, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Created reservations ['6f8295db-d31a-4c27-b11c-d9be88db0635', '52b115ea-c6a4-44e4-bd42-bb1615f388ad', '8f5eb050-8480-4927-8e8f-696121a0837b', '7c0d7c77-5269-40de-b4f8-6a1b44a2d88c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:26 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:26 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:26 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Deleted volume successfully. Nov 04 22:27:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe994b12-a349-4035-8f1e-e2c83060bacf tempest-TestInstancesWithCinderVolumes-1423201451 None] Lock "cinder-354c5069-3ba2-4f64-9957-328971d4657f-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Flow 'volume_create_manager' (295d8abe-4454-430f-8fdc-8fc8b2671a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0b2647-11f7-4fdc-99f5-9d73fd4a1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0b2647-11f7-4fdc-99f5-9d73fd4a1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1587588960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e32c177-1f23-4021-bc9c-b5f3699aefd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55fa74fa2124f5abc013daced966db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:30Z,use_quota=True,user_id='e5b6e81e1ccd46bcbd4fb41534ca6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa62dd4-7ba4-47c5-a260-05cba2d020ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa62dd4-7ba4-47c5-a260-05cba2d020ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6129a8-cf54-4e2e-a64e-7b18a5e8b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6129a8-cf54-4e2e-a64e-7b18a5e8b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e32c177-1f23-4021-bc9c-b5f3699aefd9', 'volume_name': 'volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e1c691-d62b-4ff5-accb-2d1dee759d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e1c691-d62b-4ff5-accb-2d1dee759d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886ea2f-39f7-48b6-9857-b3a1458b3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:30 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Volume 0e32c177-1f23-4021-bc9c-b5f3699aefd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9', 'volume_size': 1} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1587588960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e32c177-1f23-4021-bc9c-b5f3699aefd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55fa74fa2124f5abc013daced966db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:30Z,use_quota=True,user_id='e5b6e81e1ccd46bcbd4fb41534ca6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Creating volume 0e32c177-1f23-4021-bc9c-b5f3699aefd9 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:30 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:30 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 1073741824 Nov 04 22:27:30 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:31 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 1073741824" returned: 0 in 0.622s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:31 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 Nov 04 22:27:31 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:31 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9" returned: 0 in 0.341s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886ea2f-39f7-48b6-9857-b3a1458b3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b558100-5cee-4342-9aa9-5f441f5e4279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:31 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Volume volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 (0e32c177-1f23-4021-bc9c-b5f3699aefd9): created successfully Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b558100-5cee-4342-9aa9-5f441f5e4279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Flow 'volume_create_manager' (295d8abe-4454-430f-8fdc-8fc8b2671a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ba461c04-5616-47de-a3e3-0d19637cfe45 tempest-VolumesTransfersV357Test-903379139 None] Created volume successfully. Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=89,cinder:INSERT=28,cinder:UPDATE=103,cinder:DELETE=11 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=114,cinder:SELECT=91,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Flow 'volume_create_manager' (63c1c8e4-ae01-49cc-b0d8-35a14dc7285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187dcb98-b0dc-45be-92b0-d558125aebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187dcb98-b0dc-45be-92b0-d558125aebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1459029219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6d56b6-3593-4322-bfd4-2f06b906f102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26830722387e4f9bbf4a8dd3765959e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:33Z,use_quota=True,user_id='8d7eaeb98feb4cdfa02596b92de2a787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd0ce8f-a3c7-4041-8b9b-622dee70c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd0ce8f-a3c7-4041-8b9b-622dee70c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b08c194-3601-46fe-8673-4c00b2cc341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b08c194-3601-46fe-8673-4c00b2cc341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6d56b6-3593-4322-bfd4-2f06b906f102', 'volume_name': 'volume-9a6d56b6-3593-4322-bfd4-2f06b906f102', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be610a4e-e804-4bfe-b124-1fc8e9d523c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be610a4e-e804-4bfe-b124-1fc8e9d523c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2cab76-4b01-4fba-b93b-bd6e8c384ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:33 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Volume 9a6d56b6-3593-4322-bfd4-2f06b906f102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6d56b6-3593-4322-bfd4-2f06b906f102', 'volume_size': 1} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1459029219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6d56b6-3593-4322-bfd4-2f06b906f102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26830722387e4f9bbf4a8dd3765959e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:33Z,use_quota=True,user_id='8d7eaeb98feb4cdfa02596b92de2a787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Creating volume 9a6d56b6-3593-4322-bfd4-2f06b906f102 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:33 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:33 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 1073741824 Nov 04 22:27:33 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0bf5b50e-287a-4bd9-8271-2179e65ccade tempest-VolumesTransfersV357Test-231574415 None] Transfer volume completed successfully. Nov 04 22:27:34 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 1073741824" returned: 0 in 0.824s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "cinder-0e32c177-1f23-4021-bc9c-b5f3699aefd9-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:34 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 Nov 04 22:27:34 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-0e32c177-1f23-4021-bc9c-b5f3699aefd9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "cinder-quobyte-0e32c177-1f23-4021-bc9c-b5f3699aefd9" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-quobyte-0e32c177-1f23-4021-bc9c-b5f3699aefd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ef2e4-8e89-4aaf-9696-c91c6ce4f011]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:35 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 Nov 04 22:27:35 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:35 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102" returned: 0 in 0.378s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2cab76-4b01-4fba-b93b-bd6e8c384ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6d56b6-3593-4322-bfd4-2f06b906f102', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf791303-d8d3-478b-ba6d-8c43e1fb7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Volume volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 (9a6d56b6-3593-4322-bfd4-2f06b906f102): created successfully Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf791303-d8d3-478b-ba6d-8c43e1fb7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Flow 'volume_create_manager' (63c1c8e4-ae01-49cc-b0d8-35a14dc7285b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8378cad4-5f70-4ae3-8c64-323e55d58806 tempest-AttachVolumeShelveTestJSON-1276774134 None] Created volume successfully. Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0a342800-a4e3-49ef-b092-59b8ecc0b02f tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" by "attach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:35 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0a342800-a4e3-49ef-b092-59b8ecc0b02f tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" acquired by "attach_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:35 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9 Nov 04 22:27:35 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0a342800-a4e3-49ef-b092-59b8ecc0b02f tempest-VolumesActionsTest-1022292081 None] Attaching volume a0f22d51-8a64-4498-84cd-d3362f5cf005 to instance 9f4caf27-b3d4-432b-8bcb-c2e29dc122c8 at mountpoint /dev/vdb on host None. Nov 04 22:27:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0a342800-a4e3-49ef-b092-59b8ecc0b02f tempest-VolumesActionsTest-1022292081 None] Attach volume completed successfully. Nov 04 22:27:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0a342800-a4e3-49ef-b092-59b8ecc0b02f tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" released by "attach_volume" :: held 0.185s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-836c24a6-d8db-4b07-9b19-f5356c8edd43 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" by "detach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-836c24a6-d8db-4b07-9b19-f5356c8edd43 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:36 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-836c24a6-d8db-4b07-9b19-f5356c8edd43 tempest-VolumesActionsTest-1022292081 None] Detaching volume a0f22d51-8a64-4498-84cd-d3362f5cf005 from instance 9f4caf27-b3d4-432b-8bcb-c2e29dc122c8. Nov 04 22:27:36 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-836c24a6-d8db-4b07-9b19-f5356c8edd43 tempest-VolumesActionsTest-1022292081 None] Detach volume completed successfully. Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-836c24a6-d8db-4b07-9b19-f5356c8edd43 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:36 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0e32c177-1f23-4021-bc9c-b5f3699aefd9" returned: 0 in 0.610s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-quobyte-0e32c177-1f23-4021-bc9c-b5f3699aefd9" released by "delete_volume" :: held 1.380s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Created reservations ['21145bc1-2ccc-4652-922e-6e92fe9ba1eb', 'f6f049b4-31fb-40af-b6dc-17ccc8788f51', '19f165b4-8923-4440-b441-11ac267697ac', 'b35653bf-e6d1-4980-9bd1-025b31e088f7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:36 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:36 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:36 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.455s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:36 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Deleted volume successfully. Nov 04 22:27:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6c7320ff-332b-473f-96b7-e6eb76387cdd tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-0e32c177-1f23-4021-bc9c-b5f3699aefd9-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Flow 'volume_create_manager' (cdec1318-2b85-4dcf-9c86-aa09a28a6576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0fe1a7-8669-4acd-8910-cfcf3cb8266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0fe1a7-8669-4acd-8910-cfcf3cb8266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-22843705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55fa74fa2124f5abc013daced966db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:38Z,use_quota=True,user_id='e5b6e81e1ccd46bcbd4fb41534ca6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1a233e-db68-42b0-9263-fa1c54e9c4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1a233e-db68-42b0-9263-fa1c54e9c4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a9401-a85f-4e68-894c-2610d2b01344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a9401-a85f-4e68-894c-2610d2b01344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7', 'volume_name': 'volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af81127-6ec2-4c91-9361-8caeef3315f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af81127-6ec2-4c91-9361-8caeef3315f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3547847a-6778-470a-aa74-41cfb451560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Volume 54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7', 'volume_size': 1} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-22843705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55fa74fa2124f5abc013daced966db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:38Z,use_quota=True,user_id='e5b6e81e1ccd46bcbd4fb41534ca6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Creating volume 54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:38 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:38 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 1073741824 Nov 04 22:27:38 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:38 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 1073741824" returned: 0 in 0.697s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:39 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 Nov 04 22:27:39 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:39 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3547847a-6778-470a-aa74-41cfb451560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c56d3a0-d914-467f-8060-f5be9c068348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Volume volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 (54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7): created successfully Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c56d3a0-d914-467f-8060-f5be9c068348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Flow 'volume_create_manager' (cdec1318-2b85-4dcf-9c86-aa09a28a6576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:39 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7c089a76-614d-4a0b-a456-a355cc6bb877 tempest-VolumesTransfersV357Test-903379139 None] Created volume successfully. Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "cinder-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "cinder-quobyte-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-quobyte-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cd4363-6aa1-4ca5-8d4b-d902d7700222]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:27:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:40 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 Nov 04 22:27:40 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:41 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" returned: 0 in 0.508s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:41 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7 Nov 04 22:27:41 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:41 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-quobyte-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7" released by "delete_volume" :: held 0.957s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Created reservations ['2fb2785e-13bf-456d-a647-d2ebc8e6971c', '8ef91bbf-6969-450d-af46-418082039fb9', '934634b8-8e85-470c-b996-b74eef1611eb', '3a66a14c-505c-4d76-a434-ca11bd8c0d84'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:41 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:41 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:42 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.321s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:42 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Deleted volume successfully. Nov 04 22:27:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-db6189e0-e1f8-45c7-b516-beb3d0d860d8 tempest-VolumesTransfersV357Test-1981690720 None] Lock "cinder-54fd0fa5-6a35-46c0-a8e0-fd6f9833fec7-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:51 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:27:52 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:27:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bf52d682-3495-4025-a094-c08f4496e1f6 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" by "attach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bf52d682-3495-4025-a094-c08f4496e1f6 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" acquired by "attach_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bf52d682-3495-4025-a094-c08f4496e1f6 tempest-VolumesActionsTest-1022292081 None] Attaching volume a0f22d51-8a64-4498-84cd-d3362f5cf005 to instance f97eb3af-b16d-4fda-9dde-4df0f0acf3b8 at mountpoint /dev/vdb on host None. Nov 04 22:27:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bf52d682-3495-4025-a094-c08f4496e1f6 tempest-VolumesActionsTest-1022292081 None] Attach volume completed successfully. Nov 04 22:27:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bf52d682-3495-4025-a094-c08f4496e1f6 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005" released by "attach_volume" :: held 0.128s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cc1630d-f2ac-4525-83d9-8b8b27b6472f tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" by "detach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:27:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cc1630d-f2ac-4525-83d9-8b8b27b6472f tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:27:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9cc1630d-f2ac-4525-83d9-8b8b27b6472f tempest-VolumesActionsTest-1022292081 None] Detaching volume a0f22d51-8a64-4498-84cd-d3362f5cf005 from instance f97eb3af-b16d-4fda-9dde-4df0f0acf3b8. Nov 04 22:27:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9cc1630d-f2ac-4525-83d9-8b8b27b6472f tempest-VolumesActionsTest-1022292081 None] Detach volume completed successfully. Nov 04 22:27:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cc1630d-f2ac-4525-83d9-8b8b27b6472f tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:27:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-ec028d34-8f2f-4ac1-a242-6422457a3359 req-759745c7-1e7b-4860-bbd8-894a9cc100cb tempest-AttachVolumeShelveTestJSON-1276774134 None] No connector for attachment 1e1b22e7-c182-4fb0-875e-140513549939; skipping storage backend terminate_connection call. {{(pid=87173) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 22:27:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-ec028d34-8f2f-4ac1-a242-6422457a3359 req-759745c7-1e7b-4860-bbd8-894a9cc100cb tempest-AttachVolumeShelveTestJSON-1276774134 None] Deleting attachment 1e1b22e7-c182-4fb0-875e-140513549939. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:56 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:27:56 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (e96524dc-4f47-44ab-b159-5af1a18ef2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20e99cf-9305-442a-a083-9592a8b75cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:56 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20e99cf-9305-442a-a083-9592a8b75cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-600001331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc0ab32-96af-4e86-bae0-542f42285409,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:57Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deed22c-4294-402b-8a6e-62b32b25a7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deed22c-4294-402b-8a6e-62b32b25a7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e887124-af62-4aa4-8cd4-5b55009a11c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e887124-af62-4aa4-8cd4-5b55009a11c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc0ab32-96af-4e86-bae0-542f42285409', 'volume_name': 'volume-afc0ab32-96af-4e86-bae0-542f42285409', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada6d821-ad3a-4391-b39a-75234197505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada6d821-ad3a-4391-b39a-75234197505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7ab52b-925b-470e-a5bb-a32931fa2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:57 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Volume afc0ab32-96af-4e86-bae0-542f42285409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc0ab32-96af-4e86-bae0-542f42285409', 'volume_size': 1} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-600001331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc0ab32-96af-4e86-bae0-542f42285409,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:27:57Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Creating volume afc0ab32-96af-4e86-bae0-542f42285409 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:27:57 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:27:57 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 1073741824 Nov 04 22:27:57 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:57 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 1073741824" returned: 0 in 0.634s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:27:57 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 Nov 04 22:27:57 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:27:58 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409" returned: 0 in 0.323s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7ab52b-925b-470e-a5bb-a32931fa2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc0ab32-96af-4e86-bae0-542f42285409', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f3fbe4-6165-472d-b0ca-534b329eaeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:27:58 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Volume volume-afc0ab32-96af-4e86-bae0-542f42285409 (afc0ab32-96af-4e86-bae0-542f42285409): created successfully Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f3fbe4-6165-472d-b0ca-534b329eaeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:27:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (e96524dc-4f47-44ab-b159-5af1a18ef2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:27:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5c8dd610-290c-4083-8a84-66f02d7235ad tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (89cbeaae-5792-4e1e-ab5c-b906fccb6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b818fe-04e5-4036-93ea-eb713f6c4715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b818fe-04e5-4036-93ea-eb713f6c4715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-854075698',display_name='tempest-VolumesGetTest-Volume-1500408636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e3897a-d83c-48db-901c-204544b8fed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:00Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fc79d9-0e9e-40b5-ad2a-f207c43f0ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fc79d9-0e9e-40b5-ad2a-f207c43f0ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faeb8022-e831-419b-b8a7-584cc49f9212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faeb8022-e831-419b-b8a7-584cc49f9212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e3897a-d83c-48db-901c-204544b8fed9', 'volume_name': 'volume-a4e3897a-d83c-48db-901c-204544b8fed9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49716a68-2385-42bf-afb3-72d645c7bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49716a68-2385-42bf-afb3-72d645c7bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dafa2a2-e9c6-4ea4-856c-868df86337f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Volume a4e3897a-d83c-48db-901c-204544b8fed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e3897a-d83c-48db-901c-204544b8fed9', 'volume_size': 1} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-854075698',display_name='tempest-VolumesGetTest-Volume-1500408636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e3897a-d83c-48db-901c-204544b8fed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:00Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Creating volume a4e3897a-d83c-48db-901c-204544b8fed9 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:28:00 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:00 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 1073741824 Nov 04 22:28:00 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:00 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 1073741824" returned: 0 in 0.768s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:01 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 Nov 04 22:28:01 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:01 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9" returned: 0 in 0.343s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dafa2a2-e9c6-4ea4-856c-868df86337f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e3897a-d83c-48db-901c-204544b8fed9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac315ca3-bf4c-4c1e-a0ea-23c971fb7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:01 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Volume volume-a4e3897a-d83c-48db-901c-204544b8fed9 (a4e3897a-d83c-48db-901c-204544b8fed9): created successfully Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac315ca3-bf4c-4c1e-a0ea-23c971fb7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (89cbeaae-5792-4e1e-ab5c-b906fccb6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c49ef1f0-c201-4454-9a1b-de929d75dc4a tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde244bb-f284-4d57-8b15-4e6ce7afad08]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:01 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:01 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:01 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee84560b-4d11-40ae-b16d-6f7b85238eca]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:02 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:02 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-a4e3897a-d83c-48db-901c-204544b8fed9-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "cinder-a4e3897a-d83c-48db-901c-204544b8fed9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:02 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.599s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1p92btnet.img {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:02 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1p92btnet.img Nov 04 22:28:02 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-a4e3897a-d83c-48db-901c-204544b8fed9" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-a4e3897a-d83c-48db-901c-204544b8fed9" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3e05c-d169-4f3a-b1b0-084cdd508d9a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:02 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 Nov 04 22:28:02 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:03 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9" returned: 0 in 0.929s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:03 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9 Nov 04 22:28:03 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:04 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a4e3897a-d83c-48db-901c-204544b8fed9" returned: 0 in 0.844s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-a4e3897a-d83c-48db-901c-204544b8fed9" released by "delete_volume" :: held 1.891s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:04 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Created reservations ['88cf819d-89a3-42cb-85ff-0e44218a8240', 'df04f53b-55b8-4cf1-aeb3-b9549727b4ab', '13e6c35d-ce5b-4a55-bd69-a922dc20a587', 'c4006da8-146b-4e9a-ae60-659cfc4bfefa'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:05 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:28:05 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-afc0ab32-96af-4e86-bae0-542f42285409-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "cinder-afc0ab32-96af-4e86-bae0-542f42285409-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-afc0ab32-96af-4e86-bae0-542f42285409" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-afc0ab32-96af-4e86-bae0-542f42285409" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcca44-6313-4075-8d66-aa2181b0de01]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:05 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.654s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:28:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:28:05 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 Nov 04 22:28:05 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c188356-eb5b-4e1e-a6ba-44c099d6c640 tempest-VolumesGetTest-1265985409 None] Lock "cinder-a4e3897a-d83c-48db-901c-204544b8fed9-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:06 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409" returned: 0 in 0.709s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:06 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409 Nov 04 22:28:06 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:06 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-afc0ab32-96af-4e86-bae0-542f42285409" returned: 0 in 0.483s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-afc0ab32-96af-4e86-bae0-542f42285409" released by "delete_volume" :: held 1.302s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Created reservations ['9299bb85-fa10-4ce5-ab4c-9d88049124d5', '1441d323-c2ea-4577-a4ef-af3a7f542b81', 'e68210fc-e26c-408f-9be2-023731d5a3f0', '458a531d-a6c9-4033-9b18-5fc278e54830'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:07 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:28:07 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:07 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.415s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:28:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:28:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8288b4dc-c9ed-4614-a0e5-873630342d07 tempest-VolumesGetTest-1265985409 None] Lock "cinder-afc0ab32-96af-4e86-bae0-542f42285409-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (bfae9d1d-c52d-473b-bb3b-86111360d335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa2e8f-96ff-4af4-b914-017e2271983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa2e8f-96ff-4af4-b914-017e2271983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-538058435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eec2c65-e0c7-4954-9899-ac2188b5b51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:09Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc614e9-a685-47de-bd23-f4950c29a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc614e9-a685-47de-bd23-f4950c29a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3102ff-c701-4cf5-8a9f-3040b4378e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3102ff-c701-4cf5-8a9f-3040b4378e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'volume_name': 'volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121eb77c-5dbb-42a2-9749-3f0f8de644af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121eb77c-5dbb-42a2-9749-3f0f8de644af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96c9209-11d9-445c-a69e-596a67850106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Volume 3eec2c65-e0c7-4954-9899-ac2188b5b51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'volume_size': 1} Nov 04 22:28:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:13 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1p92btnet.img" returned: 0 in 10.532s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26fb8f-21ed-4364-9287-fe74eebe0472]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:13 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:13 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:14 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.893s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:14 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005, size 1024.00 MB, duration 10.54 sec, destination /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1p92btnet.img {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:28:14 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Converted 1024.00 MB image at 97.18 MB/s Nov 04 22:28:14 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] 5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1 was raw, no need to convert to raw {{(pid=87173) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 22:28:18 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:INSERT=6,cinder:SELECT=23,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Flow 'volume_create_manager' (4390e3b5-d351-407d-8afb-9f9fc32c8a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d6ff16-5f00-4930-b23d-c1279b5e9353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d6ff16-5f00-4930-b23d-c1279b5e9353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1552205497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca2a1b9-8a62-4a5f-81ab-97369f21dffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35113fddc54427e8883d29925dce65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:22Z,use_quota=True,user_id='5e1c246847c8402f8c8bea16e33a332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c079c-067f-4aad-9c7a-add255e3b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c079c-067f-4aad-9c7a-add255e3b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf6f129-60c9-43d5-82fc-782d5287cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf6f129-60c9-43d5-82fc-782d5287cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca2a1b9-8a62-4a5f-81ab-97369f21dffd', 'volume_name': 'volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197072c8-abd7-4750-9ede-dd77eb75392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197072c8-abd7-4750-9ede-dd77eb75392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d49f52-437d-497f-acc2-686bb61828f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume 0ca2a1b9-8a62-4a5f-81ab-97369f21dffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd', 'volume_size': 1} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Flow 'volume_create_manager' (5ec58297-0418-4d01-a019-d3fb3218470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98439722-8069-4288-9996-6a53320394d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98439722-8069-4288-9996-6a53320394d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-624833806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea4403e-bfb9-4d6b-bbf7-ffde1148d716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35113fddc54427e8883d29925dce65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:23Z,use_quota=True,user_id='5e1c246847c8402f8c8bea16e33a332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a8e80-c8b7-4fba-b9da-d9f6eb643e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a8e80-c8b7-4fba-b9da-d9f6eb643e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da92b525-90b9-4f7c-9d0a-df7620f88346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da92b525-90b9-4f7c-9d0a-df7620f88346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea4403e-bfb9-4d6b-bbf7-ffde1148d716', 'volume_name': 'volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30621f1d-863d-4564-bf60-a982f1066090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30621f1d-863d-4564-bf60-a982f1066090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953ed24e-c601-43f1-8c0f-3251d00e8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume 2ea4403e-bfb9-4d6b-bbf7-ffde1148d716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716', 'volume_size': 1} Nov 04 22:28:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:28:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.154s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Uploaded volume to glance image-id: 5d5e24b1-f7cf-4c85-ab52-07a4d11be1d1. {{(pid=87173) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.528s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-538058435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eec2c65-e0c7-4954-9899-ac2188b5b51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:09Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Creating volume 3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:28:42 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Acquiring lock "cinder-9a6d56b6-3593-4322-bfd4-2f06b906f102-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-df0d2a00-30f2-4abe-97e1-65e5d2b67922 tempest-VolumesActionsTest-1022292081 None] Copy volume to image completed successfully. Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "cinder-9a6d56b6-3593-4322-bfd4-2f06b906f102-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:42 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c 1073741824 Nov 04 22:28:42 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Acquiring lock "cinder-quobyte-9a6d56b6-3593-4322-bfd4-2f06b906f102" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "cinder-quobyte-9a6d56b6-3593-4322-bfd4-2f06b906f102" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec4fce-0bfe-42dc-8ef4-3282d82cff98]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:42 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 Nov 04 22:28:42 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:43 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c 1073741824" returned: 0 in 0.559s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:43 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102" returned: 0 in 0.481s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:43 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:28:43 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102 Nov 04 22:28:43 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:43 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:43 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9a6d56b6-3593-4322-bfd4-2f06b906f102" returned: 0 in 0.303s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "cinder-quobyte-9a6d56b6-3593-4322-bfd4-2f06b906f102" released by "delete_volume" :: held 0.848s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:43 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.042s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1552205497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca2a1b9-8a62-4a5f-81ab-97369f21dffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35113fddc54427e8883d29925dce65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:22Z,use_quota=True,user_id='5e1c246847c8402f8c8bea16e33a332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Creating volume 0ca2a1b9-8a62-4a5f-81ab-97369f21dffd {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:28:43 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96c9209-11d9-445c-a69e-596a67850106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3e70d2-79c1-4a34-a37d-39bc703c6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:43 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd 1073741824 Nov 04 22:28:43 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:43 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Volume volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c (3eec2c65-e0c7-4954-9899-ac2188b5b51c): created successfully Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3e70d2-79c1-4a34-a37d-39bc703c6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (bfae9d1d-c52d-473b-bb3b-86111360d335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b9d04034-2237-4809-bbdb-41f0d186d521 tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Created reservations ['bc72762a-6a9b-4591-aa0b-4d1eefdc6f32', '0646b77d-213c-4be3-a836-ae1f3d4f2535', '5defcf93-4446-43c7-bc07-17cdfc10a2df', '1d132f00-60f2-499b-bedd-da2460700083'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:43 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:28:43 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:44 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:28:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Deleted volume successfully. Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-573dba65-ac0e-478b-9aa5-5af8d3c78a09 tempest-AttachVolumeShelveTestJSON-1276774134 None] Lock "cinder-9a6d56b6-3593-4322-bfd4-2f06b906f102-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:44 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd 1073741824" returned: 0 in 0.712s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:44 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd Nov 04 22:28:44 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:44 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" returned: 0 in 0.346s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.649s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-624833806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea4403e-bfb9-4d6b-bbf7-ffde1148d716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35113fddc54427e8883d29925dce65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:23Z,use_quota=True,user_id='5e1c246847c8402f8c8bea16e33a332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Creating volume 2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:28:44 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d49f52-437d-497f-acc2-686bb61828f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:44 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 1073741824 Nov 04 22:28:44 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2db294-cfc3-40a6-bcc6-290238202139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd (0ca2a1b9-8a62-4a5f-81ab-97369f21dffd): created successfully Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2db294-cfc3-40a6-bcc6-290238202139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Flow 'volume_create_manager' (4390e3b5-d351-407d-8afb-9f9fc32c8a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5ae65c23-db19-49c8-b02d-da67b8449722 tempest-TestServerVolumeAttachmentScenario-391864038 None] Created volume successfully. Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (ad4f5bdf-ef66-4438-9d1c-10601703d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fc8265-9c46-449e-a89a-9b7a1c9f680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fc8265-9c46-449e-a89a-9b7a1c9f680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922419474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f36512e-6987-4626-bc5e-ac4e00d4c6fa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3eec2c65-e0c7-4954-9899-ac2188b5b51c,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:45Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39065033-eeed-4e47-a1de-eff56e8b69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39065033-eeed-4e47-a1de-eff56e8b69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a02abf4-4b22-416f-bda2-f9d189b6b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a02abf4-4b22-416f-bda2-f9d189b6b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0f36512e-6987-4626-bc5e-ac4e00d4c6fa', 'volume_name': 'volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa', 'volume_size': 1, 'source_volid': '3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'source_volstatus': 'available'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b09317-8d99-49d3-be97-a64a4e3d7f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b09317-8d99-49d3-be97-a64a4e3d7f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede89659-bbcc-4d06-9535-114d836bf747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Volume 0f36512e-6987-4626-bc5e-ac4e00d4c6fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa', 'volume_size': 1, 'source_volid': '3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'source_volstatus': 'available'} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:45 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 1073741824" returned: 0 in 0.647s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:45 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 Nov 04 22:28:45 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:45 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.137s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a72fc-f7ce-4113-b921-3819cff53731]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953ed24e-c601-43f1-8c0f-3251d00e8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124a59a4-ace9-4d90-be71-892e293e6824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Volume volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 (2ea4403e-bfb9-4d6b-bbf7-ffde1148d716): created successfully Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124a59a4-ace9-4d90-be71-892e293e6824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Flow 'volume_create_manager' (5ec58297-0418-4d01-a019-d3fb3218470e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-849bd50f-a828-48d6-878e-0f7eab98463c tempest-TestServerVolumeAttachmentScenario-391864038 None] Created volume successfully. Nov 04 22:28:45 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:45 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:46 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.546s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:46 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d98335-c1d1-4f2b-b092-273933a90cb2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:46 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:46 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:46 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.450s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:46 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img Nov 04 22:28:46 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:53 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img" returned: 0 in 7.098s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[937a3994-722c-411d-a950-fef45a58d86b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:54 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:54 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:54 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.640s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:28:54 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Converted 1024.00 MB image at 144.19 MB/s Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] 94d3d875-2f7c-4f5f-ac6e-4f501da2c62f was raw, converting to qcow2 {{(pid=87173) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb8c96-809d-439f-a52b-3109a2065366]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:54 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img Nov 04 22:28:54 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:54 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:55 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img Nov 04 22:28:55 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:55 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img" returned: 1 in 0.448s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img /opt/stack/data/cinder/conversion/vol_upload_siasleey {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:55 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img /opt/stack/data/cinder/conversion/vol_upload_siasleey Nov 04 22:28:55 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:55 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img /opt/stack/data/cinder/conversion/vol_upload_siasleey" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0f22d51-8a64-4498-84cd-d3362f5cf005.temp_image.94d3d875-2f7c-4f5f-ac6e-4f501da2c62foaduu__2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_siasleey {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:28:55 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d297d9-1309-4aea-ad68-9669a2a56894]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siasleey {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:55 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siasleey Nov 04 22:28:55 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:55 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:28:56 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siasleey" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:56 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:28:56 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:56 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Flow 'volume_create_manager' (3484f68f-1351-4c1c-8864-caefd760ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d47c53-9872-4455-a6ff-888ec02792d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d47c53-9872-4455-a6ff-888ec02792d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-53224841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec68895-9844-4781-a0d1-a15b3ff07cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f11968362474cfa99f8aef799f69c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:57Z,use_quota=True,user_id='2533cc8c2a0a4e619def5dcaca8fda1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b39e4c4-5592-496e-bbfd-b98dfd00e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b39e4c4-5592-496e-bbfd-b98dfd00e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fdd1dc-51bd-4073-a564-5224ce2ebecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fdd1dc-51bd-4073-a564-5224ce2ebecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec68895-9844-4781-a0d1-a15b3ff07cc0', 'volume_name': 'volume-fec68895-9844-4781-a0d1-a15b3ff07cc0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f584d836-630b-483c-9ea7-803a028e84bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f584d836-630b-483c-9ea7-803a028e84bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb37c3-4443-4aac-810c-0a18a86b2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:28:57 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Volume fec68895-9844-4781-a0d1-a15b3ff07cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec68895-9844-4781-a0d1-a15b3ff07cc0', 'volume_size': 1} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c4cf1519-1d5d-4576-95ed-c6728c5bd5c5 req-994a93c9-afbd-48f7-be16-15beab6bf35b tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.273s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Uploaded volume to glance image-id: 94d3d875-2f7c-4f5f-ac6e-4f501da2c62f. {{(pid=87173) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.759s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:58 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Cloning volume 3eec2c65-e0c7-4954-9899-ac2188b5b51c to volume 0f36512e-6987-4626-bc5e-ac4e00d4c6fa Nov 04 22:28:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-41ac88eb-4cbb-4b31-aac9-4e033ac44398 tempest-VolumesActionsTest-1022292081 None] Copy volume to image completed successfully. Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Creating offline snapshot c6842323-a155-4f9e-81d4-4af0029329de of volume 3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b323bc2-1686-4d8d-950a-8b97ab9bf1a8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:58 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:28:58 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:58 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:58 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de 1G Nov 04 22:28:58 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:58 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de 1G" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:58 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:28:58 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "cinder-quobyte-a0f22d51-8a64-4498-84cd-d3362f5cf005" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-quobyte-a0f22d51-8a64-4498-84cd-d3362f5cf005" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee756192-3cc8-4d7a-af2c-c7c74fcad9c1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.313s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:59 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de is being set with open permissions: ugo+rw Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:28:59 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:59 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.285s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info Nov 04 22:28:59 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005 Nov 04 22:28:59 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info" returned: 0 in 0.260s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:59 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info is being set with open permissions: ugo+rw Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a0f22d51-8a64-4498-84cd-d3362f5cf005" returned: 0 in 0.256s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:28:59 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info Nov 04 22:28:59 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-quobyte-a0f22d51-8a64-4498-84cd-d3362f5cf005" released by "delete_volume" :: held 0.703s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Created reservations ['8ed831d6-40bd-4b44-9d40-ce18f39f4059', 'f3c9034d-65bb-478f-bf7b-36413973cd8a', '42f82a34-bc1e-4594-ad86-24b4b1b37c09', 'd538fb75-9ab9-413b-b33f-7ca3d537f401'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:28:59 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:28:59 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:28:59 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Nov 04 22:28:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.info" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] snapshot: c6842323-a155-4f9e-81d4-4af0029329de, volume: 0f36512e-6987-4626-bc5e-ac4e00d4c6fa, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4008e-fd03-43c6-a263-9337a9855ad6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:00 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Deleted volume successfully. Nov 04 22:29:00 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:29:00 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3396c78e-ae43-43b8-88d9-4ec1b5860731 tempest-VolumesActionsTest-1022292081 None] Lock "cinder-a0f22d51-8a64-4498-84cd-d3362f5cf005-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:00 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.408s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9dc85-949a-4a96-9e49-1007f7f82be2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:00 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:29:00 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:00 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:29:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:00 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa Nov 04 22:29:00 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:08 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" returned: 0 in 7.169s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:29:08 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Converted 1024.00 MB image at 142.81 MB/s Nov 04 22:29:08 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa is being set with open permissions: ugo+rw Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:08 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa Nov 04 22:29:08 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:08 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" released by "_copy_volume_from_snapshot" :: held 8.283s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-c6842323-a155-4f9e-81d4-4af0029329de" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-c6842323-a155-4f9e-81d4-4af0029329de" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Deleting offline snapshot c6842323-a155-4f9e-81d4-4af0029329de of volume 3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] snapshot_file for this snap is: volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d0841d-3086-463c-aa24-42abfeb13e61]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:08 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:29:08 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:08 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[906aa51f-6372-4472-b8c8-08f50b1b234a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:08 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:29:08 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:09 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.527s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:09 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:29:09 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:09 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.381s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:09 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de Nov 04 22:29:09 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=29,cinder:SELECT=28,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:29:09 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c.c6842323-a155-4f9e-81d4-4af0029329de" returned: 0 in 0.260s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-c6842323-a155-4f9e-81d4-4af0029329de" released by "_delete_snapshot" :: held 1.660s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.031s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.807s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-53224841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec68895-9844-4781-a0d1-a15b3ff07cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f11968362474cfa99f8aef799f69c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:28:57Z,use_quota=True,user_id='2533cc8c2a0a4e619def5dcaca8fda1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Creating volume fec68895-9844-4781-a0d1-a15b3ff07cc0 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede89659-bbcc-4d06-9535-114d836bf747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa', 'volume_size': 1, 'source_volid': '3eec2c65-e0c7-4954-9899-ac2188b5b51c', 'source_volstatus': 'available'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d6010f-683d-4129-94c4-ec21564be8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 1073741824 Nov 04 22:29:10 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Volume volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa (0f36512e-6987-4626-bc5e-ac4e00d4c6fa): created successfully Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d6010f-683d-4129-94c4-ec21564be8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (ad4f5bdf-ef66-4438-9d1c-10601703d538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5474d18e-7299-48aa-b027-96dcb16251af tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:29:10 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 1073741824" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:10 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 Nov 04 22:29:10 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Flow 'volume_create_manager' (4fa66301-b9af-4cb0-8f13-d302545b4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d111aad-ea0c-4472-8242-9d72ffd58a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d111aad-ea0c-4472-8242-9d72ffd58a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1690972864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff2dbe-518f-49cc-8927-52196faf2852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d6e1838b044d73a5788c1d6b01e4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:11Z,use_quota=True,user_id='0b1f0c6fc6e441e5a5001a2fb62f8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4799ff-3d55-44c7-b0ab-7ab593af86e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4799ff-3d55-44c7-b0ab-7ab593af86e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb6711f-b226-459a-8d15-fbb32ed0d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb6711f-b226-459a-8d15-fbb32ed0d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ff2dbe-518f-49cc-8927-52196faf2852', 'volume_name': 'volume-c0ff2dbe-518f-49cc-8927-52196faf2852', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f425f-78ad-404f-b0ea-3e1740362b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f425f-78ad-404f-b0ea-3e1740362b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d3a2e5-ec2a-4650-befd-f3b9d628f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Volume c0ff2dbe-518f-49cc-8927-52196faf2852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ff2dbe-518f-49cc-8927-52196faf2852', 'volume_size': 1} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:10 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0" returned: 0 in 0.256s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c4cf1519-1d5d-4576-95ed-c6728c5bd5c5 req-994a93c9-afbd-48f7-be16-15beab6bf35b tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.158s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb37c3-4443-4aac-810c-0a18a86b2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec68895-9844-4781-a0d1-a15b3ff07cc0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9979fa-8a71-46ba-be63-344c6ea7eb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-c4cf1519-1d5d-4576-95ed-c6728c5bd5c5 req-994a93c9-afbd-48f7-be16-15beab6bf35b tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1690972864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff2dbe-518f-49cc-8927-52196faf2852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d6e1838b044d73a5788c1d6b01e4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:11Z,use_quota=True,user_id='0b1f0c6fc6e441e5a5001a2fb62f8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Creating volume c0ff2dbe-518f-49cc-8927-52196faf2852 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Volume volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 (fec68895-9844-4781-a0d1-a15b3ff07cc0): created successfully Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9979fa-8a71-46ba-be63-344c6ea7eb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:10 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 1073741824 Nov 04 22:29:10 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Flow 'volume_create_manager' (3484f68f-1351-4c1c-8864-caefd760ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-a9a5a630-9d9c-44e3-adb4-7b4f6b7a3632 req-94471980-3811-4c64-b5ae-039ef4bc4b02 tempest-VolumesGetTestJSON-1869737983 None] Created volume successfully. Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-c4cf1519-1d5d-4576-95ed-c6728c5bd5c5 req-994a93c9-afbd-48f7-be16-15beab6bf35b tempest-TestServerVolumeAttachmentScenario-391864038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0148677b-bee8-49d9-9269-6f5052c08f18', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:29:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-c4cf1519-1d5d-4576-95ed-c6728c5bd5c5 req-994a93c9-afbd-48f7-be16-15beab6bf35b tempest-TestServerVolumeAttachmentScenario-391864038 None] attachment_update completed successfully. Nov 04 22:29:11 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 1073741824" returned: 0 in 0.569s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:11 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 Nov 04 22:29:11 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (30cd1dde-4c17-45bd-91a8-97b3cd88e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca7fd4e-1737-4aec-b632-79c01036e71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca7fd4e-1737-4aec-b632-79c01036e71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1146369920',display_name='tempest-VolumesGetTest-Volume-324095466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee321c-8d1a-45b3-8394-21500d8e2f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:12Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2efac9-60ad-4673-93f1-9de809de8d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2efac9-60ad-4673-93f1-9de809de8d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8cba1a-d2d2-463a-b68d-8099e84051e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8cba1a-d2d2-463a-b68d-8099e84051e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bee321c-8d1a-45b3-8394-21500d8e2f7a', 'volume_name': 'volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f777bb-c60b-494e-9f0a-a9d2ffee0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f777bb-c60b-494e-9f0a-a9d2ffee0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5ebf69-f54c-4d02-9b27-4c38f417b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Volume 6bee321c-8d1a-45b3-8394-21500d8e2f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a', 'volume_size': 1} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:11 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852" returned: 0 in 0.347s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1146369920',display_name='tempest-VolumesGetTest-Volume-324095466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee321c-8d1a-45b3-8394-21500d8e2f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:12Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Creating volume 6bee321c-8d1a-45b3-8394-21500d8e2f7a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:11 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d3a2e5-ec2a-4650-befd-f3b9d628f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ff2dbe-518f-49cc-8927-52196faf2852', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ebf28d-dba9-4393-adb5-1476e6213f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:11 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a 1073741824 Nov 04 22:29:11 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Volume volume-c0ff2dbe-518f-49cc-8927-52196faf2852 (c0ff2dbe-518f-49cc-8927-52196faf2852): created successfully Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ebf28d-dba9-4393-adb5-1476e6213f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Flow 'volume_create_manager' (4fa66301-b9af-4cb0-8f13-d302545b4a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-03a9d958-833e-49aa-9610-30bfe7c28401 tempest-VolumesNegativeTest-1014731460 None] Created volume successfully. Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Acquiring lock "cinder-fec68895-9844-4781-a0d1-a15b3ff07cc0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "cinder-fec68895-9844-4781-a0d1-a15b3ff07cc0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Acquiring lock "cinder-quobyte-fec68895-9844-4781-a0d1-a15b3ff07cc0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "cinder-quobyte-fec68895-9844-4781-a0d1-a15b3ff07cc0" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[57998f2d-47cd-4615-a4c4-539b2e4d0440]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:12 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 Nov 04 22:29:12 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:12 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a 1073741824" returned: 0 in 0.511s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:12 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a Nov 04 22:29:12 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:12 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:12 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0 Nov 04 22:29:12 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:12 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5ebf69-f54c-4d02-9b27-4c38f417b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45625bf-e1d7-4614-ad73-86299fa41089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Volume volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a (6bee321c-8d1a-45b3-8394-21500d8e2f7a): created successfully Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45625bf-e1d7-4614-ad73-86299fa41089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (30cd1dde-4c17-45bd-91a8-97b3cd88e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b0249979-293e-4292-a562-e22198afdda0 tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:29:12 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fec68895-9844-4781-a0d1-a15b3ff07cc0" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "cinder-quobyte-fec68895-9844-4781-a0d1-a15b3ff07cc0" released by "delete_volume" :: held 0.684s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:12 devstack cinder-volume[87173]: DEBUG cinder.quota [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Created reservations ['034c6a2d-7fdc-48cf-a8d3-94226b69a4da', 'ad02432a-fa85-465d-9ad0-cf2ff3383703', '118eabbb-07be-47b9-bbd3-9bf34cea1037', 'fb6843c3-cedc-4ee1-8e07-095b08d98552'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:13 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:13 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:13 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.334s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.manager [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Deleted volume successfully. Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-9ad91342-5675-4687-8d04-5e70cea1aca5 req-1bcd0e83-210d-4a65-a13b-3817284f5dad tempest-VolumesGetTestJSON-1869737983 None] Lock "cinder-fec68895-9844-4781-a0d1-a15b3ff07cc0-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-6bee321c-8d1a-45b3-8394-21500d8e2f7a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "cinder-6bee321c-8d1a-45b3-8394-21500d8e2f7a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-6bee321c-8d1a-45b3-8394-21500d8e2f7a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-6bee321c-8d1a-45b3-8394-21500d8e2f7a" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c310e7-a283-45d6-be4e-9bbc13a40bb9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:14 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a Nov 04 22:29:14 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:14 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:14 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a Nov 04 22:29:14 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:14 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6bee321c-8d1a-45b3-8394-21500d8e2f7a" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-6bee321c-8d1a-45b3-8394-21500d8e2f7a" released by "delete_volume" :: held 0.910s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:14 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Created reservations ['88d9c254-1e23-431f-bb67-6c3626be813f', '8e374cdd-9b67-40a8-a317-41869f72a65d', '29b3e5ae-3d4a-437a-a7a6-9fa4bce4bafa', '6aeb25c7-6ca0-47d0-9590-fae316fda58e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:15 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:15 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-0f36512e-6987-4626-bc5e-ac4e00d4c6fa-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "cinder-0f36512e-6987-4626-bc5e-ac4e00d4c6fa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:15 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.452s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf8e1b6-b128-433f-92df-d602d4f21ee8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ffd37a6c-f7cd-4819-a59c-c4075808ecac tempest-VolumesGetTest-1265985409 None] Lock "cinder-6bee321c-8d1a-45b3-8394-21500d8e2f7a-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:15 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa Nov 04 22:29:15 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:16 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" returned: 0 in 0.709s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:16 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa Nov 04 22:29:16 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:16 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" returned: 0 in 0.550s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-0f36512e-6987-4626-bc5e-ac4e00d4c6fa" released by "delete_volume" :: held 1.329s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Created reservations ['28c89f15-67b8-4743-9d8c-1cb310a851d0', '31eb307a-184a-4751-8e89-699258684178', 'd585ee3e-cfcd-46cd-906b-3ec5bf743921', '572f5804-a12b-44e6-afb0-af4016227f87'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:16 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:16 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:17 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2396115b-5b39-4256-baaf-f19c79244652 tempest-VolumesGetTest-1265985409 None] Lock "cinder-0f36512e-6987-4626-bc5e-ac4e00d4c6fa-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-3eec2c65-e0c7-4954-9899-ac2188b5b51c-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "cinder-3eec2c65-e0c7-4954-9899-ac2188b5b51c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-3eec2c65-e0c7-4954-9899-ac2188b5b51c" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-3eec2c65-e0c7-4954-9899-ac2188b5b51c" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3b660-5e14-4caf-902f-cf7c6fba36d0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:18 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:29:18 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:18 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.547s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:18 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c Nov 04 22:29:18 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:18 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3eec2c65-e0c7-4954-9899-ac2188b5b51c" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-3eec2c65-e0c7-4954-9899-ac2188b5b51c" released by "delete_volume" :: held 1.072s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (d3303713-85d8-471a-8769-707ce2f22e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a6e93-3ba1-4129-a2d8-16c8505ebf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Created reservations ['068a7264-f07c-48b1-9a09-80bfc36b458c', '20c875a1-d3da-4467-9a96-1e023f0ca8e7', 'a27a84c8-cda5-4c4f-94ea-00023e84127d', 'be424479-475a-4bb5-a194-cf45158113b4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a6e93-3ba1-4129-a2d8-16c8505ebf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2120826702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598d1af3-7cc9-46ab-af82-ddb072b3f040,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:19Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd52b1-83ef-4eb8-8f2e-072c9ad467fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd52b1-83ef-4eb8-8f2e-072c9ad467fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ab2150-32d7-4fbd-bc86-45b00191b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ab2150-32d7-4fbd-bc86-45b00191b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598d1af3-7cc9-46ab-af82-ddb072b3f040', 'volume_name': 'volume-598d1af3-7cc9-46ab-af82-ddb072b3f040', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02f5f7-f08d-4e47-9319-fc14a025c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02f5f7-f08d-4e47-9319-fc14a025c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa6c717-453c-4f8e-8625-cc67a0225dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:19 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Volume 598d1af3-7cc9-46ab-af82-ddb072b3f040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598d1af3-7cc9-46ab-af82-ddb072b3f040', 'volume_size': 1} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2120826702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598d1af3-7cc9-46ab-af82-ddb072b3f040,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:19Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Creating volume 598d1af3-7cc9-46ab-af82-ddb072b3f040 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:19 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:19 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 1073741824 Nov 04 22:29:19 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-6ed99d43-5d63-450b-bb99-efb88e98b9ef req-4dbe0377-9597-4643-872e-f7f2d8cd9cd0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:19 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:19 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:19 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.319s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-635dd5eb-32d6-418d-9b2a-9383ef35bab5 tempest-VolumesGetTest-1265985409 None] Lock "cinder-3eec2c65-e0c7-4954-9899-ac2188b5b51c-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:19 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 1073741824" returned: 0 in 0.530s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:19 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 Nov 04 22:29:19 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:20 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040" returned: 0 in 0.349s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-6ed99d43-5d63-450b-bb99-efb88e98b9ef req-4dbe0377-9597-4643-872e-f7f2d8cd9cd0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.876s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa6c717-453c-4f8e-8625-cc67a0225dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598d1af3-7cc9-46ab-af82-ddb072b3f040', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c44a4d5-5088-435e-8cda-9edd55d3fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-6ed99d43-5d63-450b-bb99-efb88e98b9ef req-4dbe0377-9597-4643-872e-f7f2d8cd9cd0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:20 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Volume volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 (598d1af3-7cc9-46ab-af82-ddb072b3f040): created successfully Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c44a4d5-5088-435e-8cda-9edd55d3fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (d3303713-85d8-471a-8769-707ce2f22e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6c053bdc-271a-4652-bf9d-dc22d9c098b7 tempest-VolumesTestJSON-617172569 None] Created volume successfully. Nov 04 22:29:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-6ed99d43-5d63-450b-bb99-efb88e98b9ef req-4dbe0377-9597-4643-872e-f7f2d8cd9cd0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd1b3056-79b6-43d7-bdba-ee32ef925799', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:29:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-6ed99d43-5d63-450b-bb99-efb88e98b9ef req-4dbe0377-9597-4643-872e-f7f2d8cd9cd0 tempest-TestServerVolumeAttachmentScenario-391864038 None] attachment_update completed successfully. Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (143ee269-0154-4d7c-8322-dc428ee3d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1dc042-4113-414d-9fa6-34f682d48d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1dc042-4113-414d-9fa6-34f682d48d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-888673251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b52d26-f473-4aed-9ed2-69ad5ffcf273,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:21Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0032e2c9-ca2e-4718-bc1f-0dc1e5a4dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0032e2c9-ca2e-4718-bc1f-0dc1e5a4dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bd71a5-aa12-48af-8b63-1a8b41007703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:21 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bd71a5-aa12-48af-8b63-1a8b41007703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60b52d26-f473-4aed-9ed2-69ad5ffcf273', 'volume_name': 'volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db1bcd3-7f1e-48ee-93a7-acbbe135f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db1bcd3-7f1e-48ee-93a7-acbbe135f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9ed893-058c-4a21-b7c4-7852f18bb901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Trying to clone 60b52d26-f473-4aed-9ed2-69ad5ffcf273 from image 728a9578-311c-407d-85c9-cd39797548f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (c0826bb9-4296-4c11-bf5b-e909b0dc6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4bfff8-4885-4a53-809c-00d8be6f5063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4bfff8-4885-4a53-809c-00d8be6f5063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-901007249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55214f5c-54eb-4e55-b67e-09b5e28167b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:22Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a1b8df-4054-4035-8c6b-60b9bcbfa3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a1b8df-4054-4035-8c6b-60b9bcbfa3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77618adc-1a81-421a-93d8-fdee0ef2f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77618adc-1a81-421a-93d8-fdee0ef2f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55214f5c-54eb-4e55-b67e-09b5e28167b9', 'volume_name': 'volume-55214f5c-54eb-4e55-b67e-09b5e28167b9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957fa69-c19e-4ad0-9d8f-bb64f3ba69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957fa69-c19e-4ad0-9d8f-bb64f3ba69c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c6a198-d236-4f8e-8107-d6192c85e5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Volume 55214f5c-54eb-4e55-b67e-09b5e28167b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55214f5c-54eb-4e55-b67e-09b5e28167b9', 'volume_size': 1} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-901007249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55214f5c-54eb-4e55-b67e-09b5e28167b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:22Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Creating volume 55214f5c-54eb-4e55-b67e-09b5e28167b9 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:22 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 1073741824 Nov 04 22:29:22 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:22 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:29:22 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Image download 20.69 MB at 20.69 MB/s Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b386b2e-4cb5-4188-9f07-e92fef1d4ff8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:23 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD Nov 04 22:29:23 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:23 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 1073741824" returned: 0 in 0.863s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:23 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 is fetched for user 11a6cac5d9d244ea927eec90d4da338e. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:23 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 Nov 04 22:29:23 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49bde99-0ff4-46bd-885f-854f51a03813]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-a61e5658-0b33-43cc-86f7-da784b0a3a28 req-bc787e09-bd4e-4e9a-85e6-6163b5aef8b0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Terminate volume connection completed successfully. Nov 04 22:29:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-a61e5658-0b33-43cc-86f7-da784b0a3a28 req-bc787e09-bd4e-4e9a-85e6-6163b5aef8b0 tempest-TestServerVolumeAttachmentScenario-391864038 None] Deleting attachment bd1b3056-79b6-43d7-bdba-ee32ef925799. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:29:23 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD Nov 04 22:29:23 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:24 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9" returned: 0 in 0.405s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c6a198-d236-4f8e-8107-d6192c85e5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55214f5c-54eb-4e55-b67e-09b5e28167b9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2a35fd-41bc-4b20-a7b0-3952dc742f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Volume volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 (55214f5c-54eb-4e55-b67e-09b5e28167b9): created successfully Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2a35fd-41bc-4b20-a7b0-3952dc742f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (c0826bb9-4296-4c11-bf5b-e909b0dc6421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0b3c3ea5-795a-432b-8228-8a1b2cb14a8b tempest-VolumesTestJSON-617172569 None] Created volume successfully. Nov 04 22:29:24 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-888673251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b52d26-f473-4aed-9ed2-69ad5ffcf273,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:21Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Creating volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:24 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:24 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1073741824 Nov 04 22:29:24 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:25 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1073741824" returned: 0 in 0.868s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:25 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 Nov 04 22:29:25 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:25 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (55ee9b64-fd6e-415e-9223-6864bcdf4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59806e8-19ee-478c-9487-b35caedae64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59806e8-19ee-478c-9487-b35caedae64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-116731661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba18009-c1e2-410f-b3d9-af61fe5f5413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:25Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8af4cb5-2a59-45a6-ab29-2e3c6649e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8af4cb5-2a59-45a6-ab29-2e3c6649e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db7c7d6-0d4f-4e13-a833-0c0bc337ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db7c7d6-0d4f-4e13-a833-0c0bc337ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba18009-c1e2-410f-b3d9-af61fe5f5413', 'volume_name': 'volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba71e582-4ec2-4968-bf12-f341880ba8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba71e582-4ec2-4968-bf12-f341880ba8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1a96f8-7492-46c2-8a40-80a379b15b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:25 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Volume 1ba18009-c1e2-410f-b3d9-af61fe5f5413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413', 'volume_size': 1} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-116731661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba18009-c1e2-410f-b3d9-af61fe5f5413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f38a5be6682449fe9fa9d02cd6981733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:25Z,use_quota=True,user_id='9d01aa6d07774f74a3b6668a1716866e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Creating volume 1ba18009-c1e2-410f-b3d9-af61fe5f5413 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:25 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Attempting download of 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:29:25 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 1073741824 Nov 04 22:29:25 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd14da-92cb-4203-aad5-7e4e9e3afcd8]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:26 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv Nov 04 22:29:26 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-01cd4872-6318-46bb-8797-436110020f40 req-2b91fd84-0897-4bd7-86af-530d1638eea1 tempest-TestServerVolumeAttachmentScenario-391864038 None] Terminate volume connection completed successfully. Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-01cd4872-6318-46bb-8797-436110020f40 req-2b91fd84-0897-4bd7-86af-530d1638eea1 tempest-TestServerVolumeAttachmentScenario-391864038 None] Deleting attachment 0148677b-bee8-49d9-9269-6f5052c08f18. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:29:26 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv" returned: 0 in 0.559s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:26 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 1073741824" returned: 0 in 0.734s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:26 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 Nov 04 22:29:26 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:26 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv Nov 04 22:29:26 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:26 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv" returned: 1 in 0.498s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_3zkic3vv' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c95aad-2e20-4905-a582-2ac655fec9d8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:27 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413" returned: 0 in 0.479s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1a96f8-7492-46c2-8a40-80a379b15b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfb406e-066d-456a-8421-e3d98680c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:27 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD Nov 04 22:29:27 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:27 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Volume volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 (1ba18009-c1e2-410f-b3d9-af61fe5f5413): created successfully Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfb406e-066d-456a-8421-e3d98680c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Flow 'volume_create_manager' (55ee9b64-fd6e-415e-9223-6864bcdf4418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dd02bbed-392c-4540-9d05-6be71b8b11eb tempest-VolumesTestJSON-617172569 None] Created volume successfully. Nov 04 22:29:27 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] 728a9578-311c-407d-85c9-cd39797548f0 was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:29:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:27 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 Nov 04 22:29:27 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-1ba18009-c1e2-410f-b3d9-af61fe5f5413-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "cinder-1ba18009-c1e2-410f-b3d9-af61fe5f5413-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-quobyte-1ba18009-c1e2-410f-b3d9-af61fe5f5413" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-1ba18009-c1e2-410f-b3d9-af61fe5f5413" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef644afb-9589-428d-9423-f3e7e97e964f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:29 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 Nov 04 22:29:29 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:29 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413" returned: 0 in 0.553s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:29 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413 Nov 04 22:29:29 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:30 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1ba18009-c1e2-410f-b3d9-af61fe5f5413" returned: 0 in 0.449s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-1ba18009-c1e2-410f-b3d9-af61fe5f5413" released by "delete_volume" :: held 1.070s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:30 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273" returned: 0 in 2.904s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_i_37o4x5devstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:29:30 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Converted 112.00 MB image at 38.55 MB/s Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:30 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1G Nov 04 22:29:30 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Created reservations ['b4dc2ef5-2e58-4eac-bda6-f102e3edfb08', '6225a7aa-847a-41cc-a480-217d52c6e377', 'b8d08dbc-32b6-4ff7-9176-0e74a70ce325', '81b1ed1f-88a5-4bde-8d42-63572a746314'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:30 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:30 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:30 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 1G" returned: 0 in 0.439s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Downloaded image 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 for user 11a6cac5d9d244ea927eec90d4da338e is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Marking volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Copying metadata from image 728a9578-311c-407d-85c9-cd39797548f0 to 60b52d26-f473-4aed-9ed2-69ad5ffcf273. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Creating volume glance metadata for volume 60b52d26-f473-4aed-9ed2-69ad5ffcf273 backed by image 728a9578-311c-407d-85c9-cd39797548f0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:29:30 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.345s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Deleted volume successfully. Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9ed893-058c-4a21-b7c4-7852f18bb901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0c1df2-5a96-4976-bd35-16e8daa9b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9cb4b7af-3b58-40e8-b234-1d3f3f04a335 tempest-VolumesTestJSON-617172569 None] Lock "cinder-1ba18009-c1e2-410f-b3d9-af61fe5f5413-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:31 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Volume volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 (60b52d26-f473-4aed-9ed2-69ad5ffcf273): created successfully Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0c1df2-5a96-4976-bd35-16e8daa9b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (143ee269-0154-4d7c-8322-dc428ee3d848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a483d06e-5ad0-4b11-8716-7619341a281a tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "cinder-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-55214f5c-54eb-4e55-b67e-09b5e28167b9-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "cinder-55214f5c-54eb-4e55-b67e-09b5e28167b9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "cinder-quobyte-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-quobyte-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-quobyte-55214f5c-54eb-4e55-b67e-09b5e28167b9" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-55214f5c-54eb-4e55-b67e-09b5e28167b9" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a72db-1649-4338-afbb-28b52a697d00]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa484f-cfe6-4042-b29c-35506824dfb7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:31 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 Nov 04 22:29:31 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:31 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 Nov 04 22:29:31 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" returned: 0 in 0.457s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:32 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716 Nov 04 22:29:32 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:32 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (6745fc6c-7453-4b22-9810-f5dcaed33cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d288923b-8f3c-4afd-8dd1-3c31b48a51e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9" returned: 0 in 0.554s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d288923b-8f3c-4afd-8dd1-3c31b48a51e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-587932467',display_name='tempest-VolumesGetTest-Volume-1350162453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a332e0aa-cbef-402a-852b-ff9fded51064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:32Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9421888b-771d-4bbd-886e-39e0c20473ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9421888b-771d-4bbd-886e-39e0c20473ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:32 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9 Nov 04 22:29:32 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2f0d66-3d20-44c8-9e4f-efde184d5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2f0d66-3d20-44c8-9e4f-efde184d5563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a332e0aa-cbef-402a-852b-ff9fded51064', 'volume_name': 'volume-a332e0aa-cbef-402a-852b-ff9fded51064', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ad69a7-7b0b-4597-b624-5722c75ecaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ad69a7-7b0b-4597-b624-5722c75ecaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c32905-b027-47ea-abab-08fe21a687cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:32 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Volume a332e0aa-cbef-402a-852b-ff9fded51064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a332e0aa-cbef-402a-852b-ff9fded51064', 'volume_size': 1} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-587932467',display_name='tempest-VolumesGetTest-Volume-1350162453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a332e0aa-cbef-402a-852b-ff9fded51064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6a38c08acf4f6ca22662d12dbdcaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:32Z,use_quota=True,user_id='11a6cac5d9d244ea927eec90d4da338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Creating volume a332e0aa-cbef-402a-852b-ff9fded51064 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:32 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:32 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 1073741824 Nov 04 22:29:32 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" returned: 0 in 0.295s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-quobyte-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716" released by "delete_volume" :: held 0.836s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Created reservations ['2403bb62-37cb-4cb2-b2cb-b0ca1d613c36', 'b9c1943a-889f-47d9-8322-28543597f30e', '54dc0f5e-2e7f-401f-8fed-e434db0e2670', '452198cf-2b37-4986-a2f4-c22313e77b16'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:32 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-55214f5c-54eb-4e55-b67e-09b5e28167b9" returned: 0 in 0.377s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-55214f5c-54eb-4e55-b67e-09b5e28167b9" released by "delete_volume" :: held 0.990s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:32 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:32 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Created reservations ['55ee4ad0-ce3b-4200-923d-c979e6ffd2d1', '55ebd47a-9073-45a1-a942-460bd6c3e8fe', 'd23b2b58-8cbb-4225-94c3-1060fa363a5d', 'a3f4898b-ac5e-44f4-bab4-b28fe4c406d6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "cinder-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:32 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:32 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:32 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-598d1af3-7cc9-46ab-af82-ddb072b3f040-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "cinder-quobyte-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 1073741824" returned: 0 in 0.659s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-quobyte-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:33 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "cinder-598d1af3-7cc9-46ab-af82-ddb072b3f040-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253ed2b-09f1-4955-a6ab-b4f00521b289]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Deleted volume successfully. Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7423794b-0734-4a3d-bb4f-da4b5be388cf tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-2ea4403e-bfb9-4d6b-bbf7-ffde1148d716-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Acquiring lock "cinder-quobyte-598d1af3-7cc9-46ab-af82-ddb072b3f040" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:33 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 Nov 04 22:29:33 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-598d1af3-7cc9-46ab-af82-ddb072b3f040" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883b330-0c78-4801-9ea0-feb0aec1a3f1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:33 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd Nov 04 22:29:33 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:33 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Deleted volume successfully. Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6cb5de8a-c539-4623-ae9b-af54a36d1297 tempest-VolumesTestJSON-617172569 None] Lock "cinder-55214f5c-54eb-4e55-b67e-09b5e28167b9-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:33 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 Nov 04 22:29:33 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:33 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c32905-b027-47ea-abab-08fe21a687cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a332e0aa-cbef-402a-852b-ff9fded51064', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40b44a1-ccbd-4e54-aacc-4b9b7a43dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:33 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Volume volume-a332e0aa-cbef-402a-852b-ff9fded51064 (a332e0aa-cbef-402a-852b-ff9fded51064): created successfully Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40b44a1-ccbd-4e54-aacc-4b9b7a43dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Flow 'volume_create_manager' (6745fc6c-7453-4b22-9810-f5dcaed33cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c0e68a5d-6bd6-4f20-a882-18fb9457ee4f tempest-VolumesGetTest-1265985409 None] Created volume successfully. Nov 04 22:29:33 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" returned: 0 in 0.528s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:33 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd Nov 04 22:29:33 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:33 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040" returned: 0 in 0.494s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:33 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040 Nov 04 22:29:33 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:33 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" returned: 0 in 0.269s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-quobyte-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd" released by "delete_volume" :: held 0.877s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:33 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Created reservations ['6c6e7e2a-e8bd-4985-81fd-495709074c7f', 'ce27e653-a36c-4db9-91b6-f02f5058f358', '114ca58e-81f9-44d3-ad3c-dd0a274ec42c', '29a52711-cf25-408b-85f2-7fec7107ed12'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:34 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-598d1af3-7cc9-46ab-af82-ddb072b3f040" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "cinder-quobyte-598d1af3-7cc9-46ab-af82-ddb072b3f040" released by "delete_volume" :: held 0.837s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:34 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:34 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Created reservations ['415e9a5e-45e2-4153-88c0-cc9b9e6d8b64', '84f46a7b-d45e-4cbc-aaad-45b3b28ce6bf', '76c9ed6c-ffe3-4ef5-b6e0-569a716f8888', '10093fa4-780f-430e-8e7d-3f3d4c9c56a6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:34 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:34 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:34 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Deleted volume successfully. Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d78964e1-d431-4a0d-9d59-3d14507c34dc tempest-TestServerVolumeAttachmentScenario-391864038 None] Lock "cinder-0ca2a1b9-8a62-4a5f-81ab-97369f21dffd-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-a332e0aa-cbef-402a-852b-ff9fded51064-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "cinder-a332e0aa-cbef-402a-852b-ff9fded51064-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:34 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Deleted volume successfully. Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-a332e0aa-cbef-402a-852b-ff9fded51064" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89da5299-fb7a-4cae-8a3a-c8a9d6e2e28a tempest-VolumesTestJSON-617172569 None] Lock "cinder-598d1af3-7cc9-46ab-af82-ddb072b3f040-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-a332e0aa-cbef-402a-852b-ff9fded51064" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d4e4a-6239-4c51-b58b-32bfe085a278]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:34 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 Nov 04 22:29:34 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:35 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064" returned: 0 in 0.392s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:35 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064 Nov 04 22:29:35 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:35 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a332e0aa-cbef-402a-852b-ff9fded51064" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-a332e0aa-cbef-402a-852b-ff9fded51064" released by "delete_volume" :: held 0.773s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Created reservations ['99fd1aa1-f8da-4d2b-a9df-4f72b8324b1f', 'e62e9dfd-4c27-4af0-8ef2-73ac07d1774e', '0e708e3e-c843-4450-8763-55bee24986bb', '908a7e34-dae5-42a6-a4e5-0f984c983a3a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:35 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:35 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-60b52d26-f473-4aed-9ed2-69ad5ffcf273-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "cinder-60b52d26-f473-4aed-9ed2-69ad5ffcf273-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Acquiring lock "cinder-quobyte-60b52d26-f473-4aed-9ed2-69ad5ffcf273" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-60b52d26-f473-4aed-9ed2-69ad5ffcf273" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28cf81a-96f8-4504-b714-b2cb169b1155]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:36 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.470s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:36 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9703038c-ea5d-4cb0-b551-dbef11aa616f tempest-VolumesGetTest-1265985409 None] Lock "cinder-a332e0aa-cbef-402a-852b-ff9fded51064-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:36 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 Nov 04 22:29:36 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:36 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273" returned: 0 in 0.574s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:36 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273 Nov 04 22:29:36 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:36 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-60b52d26-f473-4aed-9ed2-69ad5ffcf273" returned: 0 in 0.336s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "cinder-quobyte-60b52d26-f473-4aed-9ed2-69ad5ffcf273" released by "delete_volume" :: held 0.998s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Acquiring lock "cinder-c0ff2dbe-518f-49cc-8927-52196faf2852-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "cinder-c0ff2dbe-518f-49cc-8927-52196faf2852-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Created reservations ['1bb39908-3e63-40fa-85ff-10dcf6cd7fa6', 'cbf7cc3a-311c-4c30-ab55-930c67f1d2e6', '688770ef-9b03-43eb-ae90-f12632244fb8', 'ad0e8b74-c0b2-4919-a6a1-4c7f0a466cd6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Acquiring lock "cinder-quobyte-c0ff2dbe-518f-49cc-8927-52196faf2852" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "cinder-quobyte-c0ff2dbe-518f-49cc-8927-52196faf2852" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8783ae5b-1b04-412d-8dfa-3e6f138d580e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:37 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:37 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:37 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 Nov 04 22:29:37 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:37 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Deleted volume successfully. Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ff404b7-5d40-4525-9cea-c8459a7af7ba tempest-VolumesGetTest-1265985409 None] Lock "cinder-60b52d26-f473-4aed-9ed2-69ad5ffcf273-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:37 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852" returned: 0 in 0.512s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:37 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852 Nov 04 22:29:37 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:37 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0ff2dbe-518f-49cc-8927-52196faf2852" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "cinder-quobyte-c0ff2dbe-518f-49cc-8927-52196faf2852" released by "delete_volume" :: held 0.847s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Created reservations ['1f0fbf78-a19f-4151-a7db-b1fa6c00c330', '583b3e6d-33b1-42c1-8f5a-665a4b37e74e', '8990cf64-43b3-4df9-b0fa-d3f956093b7c', '09b56259-1752-42c6-a7ef-93b0937b7429'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:38 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:38 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:38 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.309s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Deleted volume successfully. Nov 04 22:29:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-86cdaa9e-6e80-4afa-addd-f507d82658f3 tempest-VolumesNegativeTest-1014731460 None] Lock "cinder-c0ff2dbe-518f-49cc-8927-52196faf2852-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:29:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89153b69-23a3-424b-8d7f-048cefc6ecd2 tempest-BackendsCapabilitiesAdminTestsJSON-1032911327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5663986206055, 'free_capacity_gb': 1773.5663986206055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87173) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 22:29:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c51e2fb7-7446-4c54-bff3-d3daa165f19e tempest-BackendsCapabilitiesAdminTestsJSON-1032911327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5663986206055, 'free_capacity_gb': 1773.5663986206055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87173) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Flow 'volume_create_manager' (19788a61-483c-468a-a96f-1ca8c23fc6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61118b-6bd2-4abc-b9e7-0eda00f3fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61118b-6bd2-4abc-b9e7-0eda00f3fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-140384223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302331fa-d6dd-420f-adaf-d3c7db899eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768e9e26deaa43fd80fb2b8e9cda6cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:45Z,use_quota=True,user_id='40f304665fa14c55bcbb3d5d9815e680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e4bf9f-8f5f-4265-a07d-5b095de1ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e4bf9f-8f5f-4265-a07d-5b095de1ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b22f652-eb39-4676-a50d-bb51666762ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b22f652-eb39-4676-a50d-bb51666762ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302331fa-d6dd-420f-adaf-d3c7db899eaf', 'volume_name': 'volume-302331fa-d6dd-420f-adaf-d3c7db899eaf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b9ee55-0c23-4395-bf00-b476a4847394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b9ee55-0c23-4395-bf00-b476a4847394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba8a916-cecc-4fa0-bade-8b36190583f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Volume 302331fa-d6dd-420f-adaf-d3c7db899eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302331fa-d6dd-420f-adaf-d3c7db899eaf', 'volume_size': 1} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-140384223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302331fa-d6dd-420f-adaf-d3c7db899eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768e9e26deaa43fd80fb2b8e9cda6cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:45Z,use_quota=True,user_id='40f304665fa14c55bcbb3d5d9815e680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Creating volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:44 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:44 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf 1073741824 Nov 04 22:29:44 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:45 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf 1073741824" returned: 0 in 0.581s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:45 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf Nov 04 22:29:45 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:45 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba8a916-cecc-4fa0-bade-8b36190583f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302331fa-d6dd-420f-adaf-d3c7db899eaf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ae52e-a7f9-4873-8acf-728faa84f6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Volume volume-302331fa-d6dd-420f-adaf-d3c7db899eaf (302331fa-d6dd-420f-adaf-d3c7db899eaf): created successfully Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ae52e-a7f9-4873-8acf-728faa84f6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Flow 'volume_create_manager' (19788a61-483c-468a-a96f-1ca8c23fc6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-69097960-81a1-4fab-ad0c-f2585c4b454f tempest-VolumesSnapshotListTestJSON-1803073941 None] Created volume successfully. Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Creating offline snapshot cdd668fd-30e1-4090-9b99-37f44cc58f8e of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a33b1-ba0c-4a92-aebc-fe1be999264a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:47 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf Nov 04 22:29:47 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:47 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:47 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e 1G Nov 04 22:29:47 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:48 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e 1G" returned: 0 in 0.610s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:48 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:29:48 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:48 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.437s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:48 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e is being set with open permissions: ugo+rw Nov 04 22:29:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:48 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:29:48 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:49 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:49 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info Nov 04 22:29:49 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:49 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info" returned: 0 in 0.295s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:49 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info is being set with open permissions: ugo+rw Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:49 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info Nov 04 22:29:49 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:49 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.info" returned: 0 in 0.299s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3d6600d2-8641-45cc-b0b2-bc8f44afae2d tempest-VolumesSnapshotListTestJSON-1803073941 None] Create snapshot completed successfully Nov 04 22:29:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Creating offline snapshot ddc62000-9f0c-4ed6-a250-0f6585e860c7 of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:29:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6761e4-ec96-4a9c-9121-9ca710e1919f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:51 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:29:51 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:51 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Flow 'volume_create_manager' (f0ecd5f2-969c-4371-a3c8-526290986334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85120f2-c501-469b-bceb-a369baeee1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.626s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85120f2-c501-469b-bceb-a369baeee1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1145300914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd476851-3dc6-4ac8-aaa3-9c4c428edb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa6af554e6a4284bab461985ffdfa1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:51Z,use_quota=True,user_id='7926e024e13a4d8dbb5a862c70dc0418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:51 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 1G Nov 04 22:29:51 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d9aedb-5c68-45db-89ad-92667905fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d9aedb-5c68-45db-89ad-92667905fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584ce95-a33b-4125-8eac-aa8b12f76c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584ce95-a33b-4125-8eac-aa8b12f76c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd476851-3dc6-4ac8-aaa3-9c4c428edb97', 'volume_name': 'volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c852a922-4530-4d94-98c2-9c729053d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c852a922-4530-4d94-98c2-9c729053d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5261a2a3-41af-46eb-aa8e-0497f3aeb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97', 'volume_size': 1} Nov 04 22:29:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:52 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 1G" returned: 0 in 0.617s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:52 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:29:52 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:52 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.518s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:52 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 is being set with open permissions: ugo+rw Nov 04 22:29:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:52 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:29:52 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:53 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.352s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1145300914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd476851-3dc6-4ac8-aaa3-9c4c428edb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa6af554e6a4284bab461985ffdfa1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:51Z,use_quota=True,user_id='7926e024e13a4d8dbb5a862c70dc0418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Creating volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:53 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:53 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 1073741824 Nov 04 22:29:53 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-69d837f6-08a9-439e-930b-3b950b4782c0 tempest-VolumesSnapshotListTestJSON-1803073941 None] Create snapshot completed successfully Nov 04 22:29:53 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 1073741824" returned: 0 in 0.638s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:53 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 Nov 04 22:29:53 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:54 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5261a2a3-41af-46eb-aa8e-0497f3aeb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509545c6-23b6-441b-9301-1c55592060b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Volume volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 (cd476851-3dc6-4ac8-aaa3-9c4c428edb97): created successfully Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509545c6-23b6-441b-9301-1c55592060b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Flow 'volume_create_manager' (f0ecd5f2-969c-4371-a3c8-526290986334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f8eff034-458e-4fd8-b601-b934b15a3a0b tempest-SnapshotsActionsTest-37754386 None] Created volume successfully. Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Creating offline snapshot ad6416b0-21a8-406c-94ec-16aebdf6b941 of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3ebcd-a019-4eec-9683-b4a5760c1c14]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:54 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:29:54 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:54 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.454s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:54 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 1G Nov 04 22:29:54 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:55 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 1G" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:55 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 Nov 04 22:29:55 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:55 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:55 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 is being set with open permissions: ugo+rw Nov 04 22:29:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:56 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 Nov 04 22:29:56 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=138,cinder:SELECT=119,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Flow 'volume_create_manager' (6dc4af39-1063-46ba-b8ed-05e6807fad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519b33e4-c787-4439-8a5b-f907abd14264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519b33e4-c787-4439-8a5b-f907abd14264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93fc05a-6514-433e-ae47-cab322f29565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548e45d341e14a7b8b30a9e8f790ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:56Z,use_quota=True,user_id='9ec576a4503b4a74a5e7d152b966efa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06887b78-a794-442b-8f30-2ac1abdd743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06887b78-a794-442b-8f30-2ac1abdd743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef346e49-d8d0-44d4-b43b-6ef238084b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:29:56 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.260s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Creating offline snapshot c7a4b72a-532a-4a8d-acde-79eb30984cc9 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:29:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4d7994c7-98e2-4a8e-8a3e-54d0b9b8d318 tempest-VolumesSnapshotListTestJSON-1803073941 None] Create snapshot completed successfully Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c694650d-1a70-40b9-b043-a890266894bf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:56 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 Nov 04 22:29:56 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef346e49-d8d0-44d4-b43b-6ef238084b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f93fc05a-6514-433e-ae47-cab322f29565', 'volume_name': 'volume-f93fc05a-6514-433e-ae47-cab322f29565', 'volume_size': 1, 'image_id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af54e546a6a2f321b888b9b718f06d0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '548e45d341e14a7b8b30a9e8f790ca73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5963d3328895b1f963765e9faaff690eb0c324ab20fa0347864604f18b54c8dbb130cd200650e2ae62b9f0b1ce875e28007103a93989128cf722b11f6d4bbf8', 'id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'created_at': datetime.datetime(2026, 11, 4, 21, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb7f10-289a-4442-8d1b-6b62609482e9/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e544d8-d8ae-4231-b1ec-35c05f2948dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e544d8-d8ae-4231-b1ec-35c05f2948dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dc992b-9006-41a4-bf5f-0c2f3b4dc497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Volume f93fc05a-6514-433e-ae47-cab322f29565: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f93fc05a-6514-433e-ae47-cab322f29565', 'volume_size': 1, 'image_id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af54e546a6a2f321b888b9b718f06d0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '548e45d341e14a7b8b30a9e8f790ca73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5963d3328895b1f963765e9faaff690eb0c324ab20fa0347864604f18b54c8dbb130cd200650e2ae62b9f0b1ce875e28007103a93989128cf722b11f6d4bbf8', 'id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'created_at': datetime.datetime(2026, 11, 4, 21, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb7f10-289a-4442-8d1b-6b62609482e9/file', 'properties': {}}, 'image_service': } Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Trying to clone f93fc05a-6514-433e-ae47-cab322f29565 from image 59cb7f10-289a-4442-8d1b-6b62609482e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:29:56 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Image download 0.00 MB at 0.00 MB/s Nov 04 22:29:56 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:29:56 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0cf89-581b-4db3-8d5a-6709c08ffbef]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:29:56 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:29:56 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (9f546a01-bf88-444d-bacb-83fd7a368bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918fab6-59be-4a4c-b3d3-67b9b00229a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" returned: 0 in 0.511s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918fab6-59be-4a4c-b3d3-67b9b00229a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1881579172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a56d6-3f4e-49ff-a5d4-8637d9d55a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:57Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e9509a-93ac-42e5-ba9e-9babff942651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 1G Nov 04 22:29:56 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e9509a-93ac-42e5-ba9e-9babff942651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6643a2d-ec91-4a04-a5ed-00c0600003b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6643a2d-ec91-4a04-a5ed-00c0600003b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64a56d6-3f4e-49ff-a5d4-8637d9d55a41', 'volume_name': 'volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48656832-f366-42ed-897c-8bc370d6377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48656832-f366-42ed-897c-8bc370d6377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d80af07-3d34-4ee3-9d55-a4f0e21ceb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume d64a56d6-3f4e-49ff-a5d4-8637d9d55a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41', 'volume_size': 1} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:56 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.365s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:29:57 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:57 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:29:57 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:57 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 1G" returned: 0 in 0.419s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:57 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:29:57 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:57 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Temporary image 59cb7f10-289a-4442-8d1b-6b62609482e9 is fetched for user 9ec576a4503b4a74a5e7d152b966efa2. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead7f39-f808-4de7-8f86-ba15f0ec98bf]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:57 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 is being set with open permissions: ugo+rw Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:57 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:29:57 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:57 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:29:57 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:57 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:57 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:58 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info Nov 04 22:29:58 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:58 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:29:58 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:58 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:58 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info" returned: 0 in 0.278s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:58 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info is being set with open permissions: ugo+rw Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:58 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info Nov 04 22:29:58 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-ad6416b0-21a8-406c-94ec-16aebdf6b941-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-ad6416b0-21a8-406c-94ec-16aebdf6b941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-ad6416b0-21a8-406c-94ec-16aebdf6b941" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-ad6416b0-21a8-406c-94ec-16aebdf6b941" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Deleting offline snapshot ad6416b0-21a8-406c-94ec-16aebdf6b941 of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] snapshot_file for this snap is: volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b08945-5230-41a6-98d3-5c727bbd7c84]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:58 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.info" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1881579172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a56d6-3f4e-49ff-a5d4-8637d9d55a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:57Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating volume d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:58 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:58 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 Nov 04 22:29:58 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:58 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 1073741824 Nov 04 22:29:58 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7bb53ab7-96d8-4372-ad83-58312c188f69 tempest-SnapshotsActionsTest-37754386 None] Create snapshot completed successfully Nov 04 22:29:58 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941" returned: 0 in 0.377s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137ec55-3efc-415d-9a7c-76e53e80f417]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:29:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:58 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:29:58 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:59 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 1073741824" returned: 0 in 0.439s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:59 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 Nov 04 22:29:59 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:59 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.377s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:59 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 Nov 04 22:29:59 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:59 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93fc05a-6514-433e-ae47-cab322f29565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548e45d341e14a7b8b30a9e8f790ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:29:56Z,use_quota=True,user_id='9ec576a4503b4a74a5e7d152b966efa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Creating volume f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:29:59 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d80af07-3d34-4ee3-9d55-a4f0e21ceb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d857a843-9c32-4b3f-ae37-c1144b148638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:29:59 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1073741824 Nov 04 22:29:59 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:59 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 (d64a56d6-3f4e-49ff-a5d4-8637d9d55a41): created successfully Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d857a843-9c32-4b3f-ae37-c1144b148638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (9f546a01-bf88-444d-bacb-83fd7a368bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:29:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-39c35373-3f2c-4707-a6b0-bce666275f82 tempest-VolumesSnapshotTestJSON-1879738912 None] Created volume successfully. Nov 04 22:29:59 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941" returned: 0 in 0.478s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:59 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941 Nov 04 22:29:59 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:29:59 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1073741824" returned: 0 in 0.534s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:29:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:29:59 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 Nov 04 22:29:59 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:00 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ad6416b0-21a8-406c-94ec-16aebdf6b941" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-ad6416b0-21a8-406c-94ec-16aebdf6b941" released by "_delete_snapshot" :: held 1.630s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" released by "delete_snapshot" :: held 1.659s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Created reservations ['419798eb-28fb-4407-adea-1a5f02e492ac', '211b087a-de2f-49c0-b654-db91dcae3c0b', '63816ddb-80ad-4423-a271-cd1648ee6221', '0edd1ec2-fab9-49cb-9ba0-53d44c5458c0'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:00 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.382s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Creating offline snapshot 5ce56a3d-4f1e-4e35-aaec-765b9bad2378 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Attempting download of 59cb7f10-289a-4442-8d1b-6b62609482e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}])) to volume f93fc05a-6514-433e-ae47-cab322f29565. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742c7d7-0aa5-4560-9b2f-b7ba2ef078cd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Delete snapshot completed successfully. Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e196f974-eb7f-4f61-a99a-7670fa92de16 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-ad6416b0-21a8-406c-94ec-16aebdf6b941-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[79957acb-cc35-41e5-805a-187cc164f2b9]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:00 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:00 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:00 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny Nov 04 22:30:00 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-ddc62000-9f0c-4ed6-a250-0f6585e860c7-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-ddc62000-9f0c-4ed6-a250-0f6585e860c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-ddc62000-9f0c-4ed6-a250-0f6585e860c7" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-ddc62000-9f0c-4ed6-a250-0f6585e860c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Deleting offline snapshot ddc62000-9f0c-4ed6-a250-0f6585e860c7 of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] snapshot_file for this snap is: volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a534b2-9438-4f01-a7ea-47d94f919e5c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:00 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.457s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:00 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:00 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 1G Nov 04 22:30:00 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny" returned: 0 in 0.432s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:00 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:30:00 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:00 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny Nov 04 22:30:00 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8697d85-28cf-4629-9adc-24f28e69bf73]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny" returned: 1 in 0.355s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb7f10-289a-4442-8d1b-6b62609482e9__qew_nny' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db31207-9174-475a-9c49-0b95e316aab1]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 1G" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:30:01 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 Nov 04 22:30:01 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:30:01 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.386s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:30:01 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 is being set with open permissions: ugo+rw Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 Nov 04 22:30:01 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD Nov 04 22:30:01 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378" returned: 0 in 0.263s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.655s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.269s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating offline snapshot b8a35f93-76b0-4a18-96cf-e9fe21ee7afe of volume d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f756ce4c-3019-4d49-b920-6003c1f4c3d1 tempest-SnapshotsActionsTest-37754386 None] Create snapshot completed successfully Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766463f-c61b-4695-968f-81bd2477f262]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] 59cb7f10-289a-4442-8d1b-6b62609482e9 was raw, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.441s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:01 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 Nov 04 22:30:01 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:01 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7 Nov 04 22:30:01 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:02 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 Nov 04 22:30:02 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:02 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.ddc62000-9f0c-4ed6-a250-0f6585e860c7" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-ddc62000-9f0c-4ed6-a250-0f6585e860c7" released by "_delete_snapshot" :: held 1.589s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" released by "delete_snapshot" :: held 1.614s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:02 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" returned: 0 in 0.418s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Created reservations ['7504bada-cabc-497b-b1ee-217f6240d1c9', '54908bc9-d371-495c-a5e8-44271485de14', '78a388ab-ab64-4a8b-9d59-00dd0483cbe1', '3f94ae76-3353-4981-a34b-d7288b7c68a2'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:02 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe 1G Nov 04 22:30:02 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:02 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Delete snapshot completed successfully. Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-065ca480-9f03-4822-93f8-c1c691dcf457 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-ddc62000-9f0c-4ed6-a250-0f6585e860c7-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:02 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565" returned: 0 in 0.558s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59cb7f10-289a-4442-8d1b-6b62609482e9_is7vi7cvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:30:02 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:02 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1G Nov 04 22:30:02 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-cdd668fd-30e1-4090-9b99-37f44cc58f8e-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-cdd668fd-30e1-4090-9b99-37f44cc58f8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:02 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-cdd668fd-30e1-4090-9b99-37f44cc58f8e" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe 1G" returned: 0 in 0.498s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-cdd668fd-30e1-4090-9b99-37f44cc58f8e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:02 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe Nov 04 22:30:02 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Deleting offline snapshot cdd668fd-30e1-4090-9b99-37f44cc58f8e of volume 302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:02 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] snapshot_file for this snap is: volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 1G" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Downloaded image 59cb7f10-289a-4442-8d1b-6b62609482e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}])) to volume f93fc05a-6514-433e-ae47-cab322f29565 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Temporary image 59cb7f10-289a-4442-8d1b-6b62609482e9 for user 9ec576a4503b4a74a5e7d152b966efa2 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Marking volume f93fc05a-6514-433e-ae47-cab322f29565 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Copying metadata from image 59cb7f10-289a-4442-8d1b-6b62609482e9 to f93fc05a-6514-433e-ae47-cab322f29565. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Creating volume glance metadata for volume f93fc05a-6514-433e-ae47-cab322f29565 backed by image 59cb7f10-289a-4442-8d1b-6b62609482e9 with: {'image_id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'af54e546a6a2f321b888b9b718f06d0a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ec322-75c2-4b8e-bb9a-86a29422d6e7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dc992b-9006-41a4-bf5f-0c2f3b4dc497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93fc05a-6514-433e-ae47-cab322f29565', 'volume_size': 1, 'image_id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb7f10-289a-4442-8d1b-6b62609482e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af54e546a6a2f321b888b9b718f06d0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '548e45d341e14a7b8b30a9e8f790ca73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5963d3328895b1f963765e9faaff690eb0c324ab20fa0347864604f18b54c8dbb130cd200650e2ae62b9f0b1ce875e28007103a93989128cf722b11f6d4bbf8', 'id': '59cb7f10-289a-4442-8d1b-6b62609482e9', 'created_at': datetime.datetime(2026, 11, 4, 21, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb7f10-289a-4442-8d1b-6b62609482e9/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daeec47-5e0b-42cf-ae8a-66acd33cec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:03 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Volume volume-f93fc05a-6514-433e-ae47-cab322f29565 (f93fc05a-6514-433e-ae47-cab322f29565): created successfully Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daeec47-5e0b-42cf-ae8a-66acd33cec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Flow 'volume_create_manager' (6dc4af39-1063-46ba-b8ed-05e6807fad7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-370c6430-bbf4-4138-970c-2a1ba53e9f78 tempest-VolumeImageDependencyTests-1866490125 None] Created volume successfully. Nov 04 22:30:03 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:30:03 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-5ce56a3d-4f1e-4e35-aaec-765b9bad2378-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-5ce56a3d-4f1e-4e35-aaec-765b9bad2378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-5ce56a3d-4f1e-4e35-aaec-765b9bad2378" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-5ce56a3d-4f1e-4e35-aaec-765b9bad2378" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Deleting offline snapshot 5ce56a3d-4f1e-4e35-aaec-765b9bad2378 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:03 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] snapshot_file for this snap is: volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe is being set with open permissions: ugo+rw Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eee711c-76f9-4197-b1cb-9e019624c73e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe Nov 04 22:30:03 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 Nov 04 22:30:03 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.529s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-302331fa-d6dd-420f-adaf-d3c7db899eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a43dc-9047-45d8-b5be-265b98f4d306]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Acquiring lock "cinder-f93fc05a-6514-433e-ae47-cab322f29565-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:03 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info Nov 04 22:30:03 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "cinder-f93fc05a-6514-433e-ae47-cab322f29565-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:03 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf Nov 04 22:30:03 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Acquiring lock "cinder-quobyte-f93fc05a-6514-433e-ae47-cab322f29565" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "cinder-quobyte-f93fc05a-6514-433e-ae47-cab322f29565" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfff366-5944-4b30-8a74-e52e75a373f1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378" returned: 0 in 0.545s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8c9e8-7709-46cb-af01-b91f29139031]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 Nov 04 22:30:03 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info is being set with open permissions: ugo+rw Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf" returned: 0 in 0.482s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:03 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info Nov 04 22:30:03 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:03 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:03 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:30:04 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565" returned: 0 in 0.456s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:04 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565 Nov 04 22:30:04 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.info" returned: 0 in 0.312s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:04 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.504s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:04 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 Nov 04 22:30:04 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9092d285-6978-4b5f-b096-db0a6b29a717 tempest-VolumesSnapshotTestJSON-1879738912 None] Create snapshot completed successfully Nov 04 22:30:04 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.417s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:04 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e Nov 04 22:30:04 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f93fc05a-6514-433e-ae47-cab322f29565" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "cinder-quobyte-f93fc05a-6514-433e-ae47-cab322f29565" released by "delete_volume" :: held 0.808s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Created reservations ['d2062c3c-504e-461d-aa27-898c36a81cd2', '77e443dc-2963-4edf-bd4e-ea8f3eb9f9cf', '04bdfc84-f8c7-49f0-aac8-9a817bc3cda5', 'cbe1b252-b019-4149-b212-4fffc4236f60'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:04 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf.cdd668fd-30e1-4090-9b99-37f44cc58f8e" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:04 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-cdd668fd-30e1-4090-9b99-37f44cc58f8e" released by "_delete_snapshot" :: held 1.896s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" released by "delete_snapshot" :: held 1.950s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:04 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378" returned: 0 in 0.523s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:04 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378 Nov 04 22:30:04 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Created reservations ['9a950b97-6963-44cc-bb6f-3609564768b0', '926b9646-eba7-4d4d-8211-15c5e43235cd', 'b46d3e07-cf9e-4a90-ace1-31c8c6390105', '99b09dc1-c5a4-45b0-a94f-a8236018fbe7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:04 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Deleted volume successfully. Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b79bce28-3c28-4a32-b55f-dc32fbba3125 tempest-VolumeImageDependencyTests-1866490125 None] Lock "cinder-f93fc05a-6514-433e-ae47-cab322f29565-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Delete snapshot completed successfully. Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ed67e2d1-1015-474f-91fb-5385b39c3d09 tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-cdd668fd-30e1-4090-9b99-37f44cc58f8e-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleting offline snapshot b8a35f93-76b0-4a18-96cf-e9fe21ee7afe of volume d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] snapshot_file for this snap is: volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c967e8-1525-40f2-91fc-f439bf10b20c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:05 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.5ce56a3d-4f1e-4e35-aaec-765b9bad2378" returned: 0 in 0.403s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-5ce56a3d-4f1e-4e35-aaec-765b9bad2378" released by "_delete_snapshot" :: held 2.105s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_snapshot" :: held 2.138s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:05 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe Nov 04 22:30:05 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Created reservations ['d12183a6-838c-43da-8b04-a69f8f0eda79', 'c57c1757-a4fe-4a03-b1f3-85edb24cbda7', 'd36d81fb-7fa3-4e96-9262-13a50ca43e78', 'b3a3442b-5cce-4786-8d37-f2641051e01e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Delete snapshot completed successfully. Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cdde809f-a05b-4e09-a1ae-32cd819671f9 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-5ce56a3d-4f1e-4e35-aaec-765b9bad2378-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:05 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776c932-d9f3-42b2-8c26-289e107a153d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:05 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 Nov 04 22:30:05 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:06 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" returned: 0 in 0.415s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:06 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe Nov 04 22:30:06 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-302331fa-d6dd-420f-adaf-d3c7db899eaf-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-302331fa-d6dd-420f-adaf-d3c7db899eaf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d1437-613c-4ea0-9097-e2b4c46d2157]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:06 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf Nov 04 22:30:06 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:06 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" returned: 0 in 0.473s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:06 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe Nov 04 22:30:06 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Creating offline snapshot b9640fcf-60d8-45a0-96c2-f174ade6a463 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d9fc3-d970-4228-9941-68efb01f8f7e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:06 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf" returned: 0 in 0.533s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:06 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41.b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:06 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf Nov 04 22:30:06 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe" released by "_delete_snapshot" :: held 1.759s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" released by "delete_snapshot" :: held 1.786s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:06 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:06 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['fb805135-c1b1-4948-9db1-c5f2ae895ccf', 'c2884324-0a92-4dfa-a715-9c5c1b4488d1', 'bb80d04c-fb5f-464e-82a5-1e79d4e0beeb', '66871bc9-32b1-4536-bf51-87487c3fd332'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Delete snapshot completed successfully. Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-81c8e318-38b8-412f-95a6-b548488722d2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-b8a35f93-76b0-4a18-96cf-e9fe21ee7afe-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:07 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-302331fa-d6dd-420f-adaf-d3c7db899eaf" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-quobyte-302331fa-d6dd-420f-adaf-d3c7db899eaf" released by "delete_volume" :: held 1.015s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Created reservations ['19cf2212-1085-4cfd-b9f0-31af2c7785ef', '40ecb029-37bc-4294-a442-a744ba3d2776', 'd2138f97-aab5-4213-8aef-c5a26aa7dd1b', 'a9b7066d-9da7-4503-b618-7ffb4885b361'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:07 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.530s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:07 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 1G Nov 04 22:30:07 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:07 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:07 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:07 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Deleted volume successfully. Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3b2900a5-3ecb-4671-bba3-9c8569a8288f tempest-VolumesSnapshotListTestJSON-1803073941 None] Lock "cinder-302331fa-d6dd-420f-adaf-d3c7db899eaf-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:08 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2a62cf2a-5799-4797-b30d-0371acd8a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2de5681-63fe-4280-832c-f3cdc6a419b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 1G" returned: 0 in 0.648s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2de5681-63fe-4280-832c-f3cdc6a419b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-75371904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62faa6-a99f-40d2-9b74-20f102f744d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:08Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:08 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 Nov 04 22:30:08 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da3e4a-f6f3-4b10-9e1c-a76f7ae246e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da3e4a-f6f3-4b10-9e1c-a76f7ae246e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c1ba7b-79dd-4980-95e2-9d4cd1c19d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c1ba7b-79dd-4980-95e2-9d4cd1c19d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c62faa6-a99f-40d2-9b74-20f102f744d5', 'volume_name': 'volume-3c62faa6-a99f-40d2-9b74-20f102f744d5', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8229f1-bbc5-473f-ae3a-689803c0cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8229f1-bbc5-473f-ae3a-689803c0cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641364e0-5a90-41bb-88d0-8eab1849e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Volume 3c62faa6-a99f-40d2-9b74-20f102f744d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c62faa6-a99f-40d2-9b74-20f102f744d5', 'volume_size': 1} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:08 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:08 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 is being set with open permissions: ugo+rw Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:08 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 Nov 04 22:30:08 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:08 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-75371904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62faa6-a99f-40d2-9b74-20f102f744d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:08Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Creating volume 3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:08 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:30:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:08 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 1073741824 Nov 04 22:30:08 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f30b64c6-c1b5-4063-aabd-2c06d7fdd52c tempest-SnapshotsActionsTest-37754386 None] Create snapshot completed successfully Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-b9640fcf-60d8-45a0-96c2-f174ade6a463-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-b9640fcf-60d8-45a0-96c2-f174ade6a463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-b9640fcf-60d8-45a0-96c2-f174ade6a463" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-b9640fcf-60d8-45a0-96c2-f174ade6a463" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Deleting offline snapshot b9640fcf-60d8-45a0-96c2-f174ade6a463 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] snapshot_file for this snap is: volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f76893-0166-4a5d-9a5b-aa4e94c56703]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:09 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 1073741824" returned: 0 in 0.580s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:09 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:09 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:09 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 Nov 04 22:30:09 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:09 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641364e0-5a90-41bb-88d0-8eab1849e363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c62faa6-a99f-40d2-9b74-20f102f744d5', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dcc06e-af3f-4f9f-8aa7-20fecf3dd3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Volume volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 (3c62faa6-a99f-40d2-9b74-20f102f744d5): created successfully Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dcc06e-af3f-4f9f-8aa7-20fecf3dd3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2a62cf2a-5799-4797-b30d-0371acd8a039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b88e5133-0fe5-4ebd-808c-c60e0f84630b tempest-VolumesSnapshotTestJSON-1879738912 None] Created volume successfully. Nov 04 22:30:09 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e463ff-b7cc-4c0d-956f-6eee1256fec8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Flow 'volume_create_manager' (408806a9-a24e-4c35-90bf-84042504797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fffffc-5ba3-4a14-a081-62553a45d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fffffc-5ba3-4a14-a081-62553a45d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409611772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a982c5-108d-41d1-8e92-e6eba41c5e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a014e1d6d034bd49b7f6030a09734e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:10Z,use_quota=True,user_id='bc1dd782d05b417f9bfc198cd70d3b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e36ab88-fa13-43db-807f-063ca57c7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e36ab88-fa13-43db-807f-063ca57c7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cffc1c-683a-4f94-b540-77c2595a008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cffc1c-683a-4f94-b540-77c2595a008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a982c5-108d-41d1-8e92-e6eba41c5e75', 'volume_name': 'volume-16a982c5-108d-41d1-8e92-e6eba41c5e75', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aa046c-3686-48e9-8302-1ab3e60b21cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:09 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aa046c-3686-48e9-8302-1ab3e60b21cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26605a7d-60ff-4e6f-8000-9468986076ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Volume 16a982c5-108d-41d1-8e92-e6eba41c5e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a982c5-108d-41d1-8e92-e6eba41c5e75', 'volume_size': 1} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409611772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a982c5-108d-41d1-8e92-e6eba41c5e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a014e1d6d034bd49b7f6030a09734e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:10Z,use_quota=True,user_id='bc1dd782d05b417f9bfc198cd70d3b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Creating volume 16a982c5-108d-41d1-8e92-e6eba41c5e75 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:09 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:30:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:09 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 1073741824 Nov 04 22:30:09 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:10 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.530s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:10 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 Nov 04 22:30:10 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=198,cinder:SELECT=178,cinder:INSERT=55,cinder:DELETE=20 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:10 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 1073741824" returned: 0 in 0.679s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:10 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 Nov 04 22:30:10 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:10 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463" returned: 0 in 0.538s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:10 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463 Nov 04 22:30:10 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:10 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.432s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Creating offline snapshot a078c8c5-11ac-432c-bfa4-2c7dbaa956ef of volume 3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26605a7d-60ff-4e6f-8000-9468986076ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a982c5-108d-41d1-8e92-e6eba41c5e75', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba641d-58f8-41e4-b70a-95fe29282c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4493ba6-6996-4f8c-b756-b057cc1265f3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Volume volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 (16a982c5-108d-41d1-8e92-e6eba41c5e75): created successfully Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba641d-58f8-41e4-b70a-95fe29282c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Flow 'volume_create_manager' (408806a9-a24e-4c35-90bf-84042504797b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bbb389ac-aa7e-4dba-8cdd-950cce6016da tempest-ProjectReaderTests-1499820989 None] Created volume successfully. Nov 04 22:30:11 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:11 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:11 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.b9640fcf-60d8-45a0-96c2-f174ade6a463" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-b9640fcf-60d8-45a0-96c2-f174ade6a463" released by "_delete_snapshot" :: held 1.994s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_snapshot" :: held 2.027s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Created reservations ['63c42cd3-22dd-44be-b0e7-c6ba01fc753f', '0062c2c1-97f7-421b-93cc-bbe01b862d8d', '4cadae02-dd93-4f8b-94da-3d90a5e67347', '5c5665b3-1969-478a-b797-d8dab0391d80'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Delete snapshot completed successfully. Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fe95aa42-00db-4910-a26e-75bada136938 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-b9640fcf-60d8-45a0-96c2-f174ade6a463-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:11 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:11 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef 1G Nov 04 22:30:11 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:11 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef 1G" returned: 0 in 0.428s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:11 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:11 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Acquiring lock "cinder-16a982c5-108d-41d1-8e92-e6eba41c5e75-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:12 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:12 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef is being set with open permissions: ugo+rw Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "cinder-16a982c5-108d-41d1-8e92-e6eba41c5e75-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:12 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:12 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Acquiring lock "cinder-quobyte-16a982c5-108d-41d1-8e92-e6eba41c5e75" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "cinder-quobyte-16a982c5-108d-41d1-8e92-e6eba41c5e75" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3985aa74-284c-409c-ab3e-5af4770bcc2b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:12 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:12 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.295s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:12 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:12 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info Nov 04 22:30:12 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:12 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75" returned: 0 in 0.546s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:12 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75 Nov 04 22:30:12 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:12 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info" returned: 0 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:12 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info is being set with open permissions: ugo+rw Nov 04 22:30:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:12 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info Nov 04 22:30:12 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:13 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-16a982c5-108d-41d1-8e92-e6eba41c5e75" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "cinder-quobyte-16a982c5-108d-41d1-8e92-e6eba41c5e75" released by "delete_volume" :: held 0.895s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:13 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.info" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.371s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Creating offline snapshot 866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02613fa-c7a5-44f3-9923-f6d796d2809b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5b3bb87b-02a1-4d31-b3bf-bf12616341ea tempest-VolumesSnapshotTestJSON-1879738912 None] Create snapshot completed successfully Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Created reservations ['b46f1a1d-81db-4ceb-9048-87343fae43cf', '8561afd9-8638-4eed-b947-3b9100fb3eda', 'fd537c6d-0d33-4fc0-bf72-5c5f8330ecc6', 'ee3cf1f8-5653-4626-841c-9a6843dafd51'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:13 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:13 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:13 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:13 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:13 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.427s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:13 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 1G Nov 04 22:30:13 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:13 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.323s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Deleted volume successfully. Nov 04 22:30:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c221b8ab-6fe5-42a6-8b34-f4377217d24c tempest-ProjectReaderTests-1499820989 None] Lock "cinder-16a982c5-108d-41d1-8e92-e6eba41c5e75-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:14 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 1G" returned: 0 in 0.597s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:14 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 Nov 04 22:30:14 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (1321dd55-de8a-4b9d-8bea-9a28655e9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97d49c8-5c93-46dc-b807-eac0c6d86ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97d49c8-5c93-46dc-b807-eac0c6d86ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-491716077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280e537c-2270-4f29-97b9-8253c0692728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a078c8c5-11ac-432c-bfa4-2c7dbaa956ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:14Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10073878-e818-449f-a917-1febf3dffc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10073878-e818-449f-a917-1febf3dffc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c772541-e069-4516-b17a-157078309685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c772541-e069-4516-b17a-157078309685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '280e537c-2270-4f29-97b9-8253c0692728', 'volume_name': 'volume-280e537c-2270-4f29-97b9-8253c0692728', 'volume_size': 2, 'snapshot_id': 'a078c8c5-11ac-432c-bfa4-2c7dbaa956ef'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ccf4fe-7dac-4448-bff2-c43b513396ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ccf4fe-7dac-4448-bff2-c43b513396ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c179cf-b8d1-4fc6-9dbf-636a892d4c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume 280e537c-2270-4f29-97b9-8253c0692728: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-280e537c-2270-4f29-97b9-8253c0692728', 'volume_size': 2, 'snapshot_id': 'a078c8c5-11ac-432c-bfa4-2c7dbaa956ef'} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:14 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" returned: 0 in 0.399s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:14 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 is being set with open permissions: ugo+rw Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:14 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 Nov 04 22:30:14 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Flow 'volume_create_manager' (bd5754c2-9da0-48cc-9456-9c55510f742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9b29e7-7f67-4ccc-ba37-4b0410b10d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9b29e7-7f67-4ccc-ba37-4b0410b10d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277906351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37bf1c-06f4-4388-8267-061a24560a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a014e1d6d034bd49b7f6030a09734e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:15Z,use_quota=True,user_id='bc1dd782d05b417f9bfc198cd70d3b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2667360-be06-4811-81e0-7f924fc86820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:15 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2667360-be06-4811-81e0-7f924fc86820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52456f8f-0a99-42a8-95a9-a1ab412b59dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52456f8f-0a99-42a8-95a9-a1ab412b59dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e37bf1c-06f4-4388-8267-061a24560a12', 'volume_name': 'volume-2e37bf1c-06f4-4388-8267-061a24560a12', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a063c6-b38a-4802-864d-146a383a6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a063c6-b38a-4802-864d-146a383a6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0afc2a9-2e79-4aa9-bb39-800bc61c3d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Volume 2e37bf1c-06f4-4388-8267-061a24560a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e37bf1c-06f4-4388-8267-061a24560a12', 'volume_size': 1} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" returned: 0 in 0.330s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.568s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-280e537c-2270-4f29-97b9-8253c0692728" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-280e537c-2270-4f29-97b9-8253c0692728" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating volume 280e537c-2270-4f29-97b9-8253c0692728 from snapshot a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3ce31ba2-94ac-4f4d-aebf-9b2d75166d27 tempest-SnapshotsActionsTest-37754386 None] Create snapshot completed successfully Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] snapshot: a078c8c5-11ac-432c-bfa4-2c7dbaa956ef, volume: 280e537c-2270-4f29-97b9-8253c0692728, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce357d0-6f3d-49b4-8eb6-9a9b7a318163]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:15 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:15 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:15 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c62faa6-a99f-40d2-9b74-20f102f744d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6af529-8b44-4718-9398-16864bc45e48]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:15 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:15 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:16 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:16 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 Nov 04 22:30:16 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Deleting offline snapshot 866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] snapshot_file for this snap is: volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bfc38-4a1e-497a-9e76-5a2aa12ddf90]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:16 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 Nov 04 22:30:16 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:16 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" returned: 0 in 0.565s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad4009-b006-4cc1-9ad7-a40b7779eb10]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:17 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:17 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:17 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.926s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:17 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 Nov 04 22:30:17 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:18 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" returned: 0 in 0.912s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:18 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7 Nov 04 22:30:18 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:19 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" returned: 0 in 0.530s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7" released by "_delete_snapshot" :: held 3.150s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_snapshot" :: held 3.189s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:19 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Created reservations ['76152a3d-4a57-41fc-91fc-d36d11d7a696', '1466704f-6a26-4840-9ded-2c71b7c614a6', '3d41fbc5-1772-4d7d-98df-7adce201c5b8', 'c2197434-c254-4217-91c0-9e56af50a241'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Delete snapshot completed successfully. Nov 04 22:30:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c29802f-79a8-472b-9fe4-0409e60e20b8 tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-866a5cf2-260e-4d75-bb3b-8211e4d9a3e7-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:24 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728" returned: 0 in 8.759s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:24 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:30:24 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Converted 1024.00 MB image at 116.89 MB/s Nov 04 22:30:24 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 is being set with open permissions: ugo+rw Nov 04 22:30:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:24 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 Nov 04 22:30:24 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:25 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728" returned: 0 in 0.274s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" released by "_copy_volume_from_snapshot" :: held 9.979s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-280e537c-2270-4f29-97b9-8253c0692728" released by "_create_volume_from_snapshot" :: held 10.050s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.079s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.128s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277906351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37bf1c-06f4-4388-8267-061a24560a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a014e1d6d034bd49b7f6030a09734e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:15Z,use_quota=True,user_id='bc1dd782d05b417f9bfc198cd70d3b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Creating volume 2e37bf1c-06f4-4388-8267-061a24560a12 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:25 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:25 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 1073741824 Nov 04 22:30:25 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c179cf-b8d1-4fc6-9dbf-636a892d4c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280e537c-2270-4f29-97b9-8253c0692728', 'volume_size': 2, 'snapshot_id': 'a078c8c5-11ac-432c-bfa4-2c7dbaa956ef'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92facef-0ece-483b-93c1-ff8179930372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:25 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume volume-280e537c-2270-4f29-97b9-8253c0692728 (280e537c-2270-4f29-97b9-8253c0692728): created successfully Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92facef-0ece-483b-93c1-ff8179930372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (1321dd55-de8a-4b9d-8bea-9a28655e9cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dd16286c-63d3-457b-8361-0021ac1825d0 tempest-VolumesSnapshotTestJSON-1879738912 None] Created volume successfully. Nov 04 22:30:25 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 1073741824" returned: 0 in 0.484s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:25 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 Nov 04 22:30:25 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:26 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.485s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0afc2a9-2e79-4aa9-bb39-800bc61c3d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e37bf1c-06f4-4388-8267-061a24560a12', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b80bc-473b-4fa0-8cb2-0437f2f4e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Creating offline snapshot c23b54b0-2b87-4772-a94e-4adea898c4fd of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:26 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Volume volume-2e37bf1c-06f4-4388-8267-061a24560a12 (2e37bf1c-06f4-4388-8267-061a24560a12): created successfully Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b80bc-473b-4fa0-8cb2-0437f2f4e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Flow 'volume_create_manager' (bd5754c2-9da0-48cc-9456-9c55510f742a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9168401-8bb2-4ccc-a83b-a3dee5b290b0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6699dba8-ae4b-46da-9ff2-f32639558f33 tempest-ProjectReaderTests-1499820989 None] Created volume successfully. Nov 04 22:30:26 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:26 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-280e537c-2270-4f29-97b9-8253c0692728-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-280e537c-2270-4f29-97b9-8253c0692728-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:26 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.512s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:26 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd 1G Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:26 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c56811-71d9-46b3-b598-dadc0fe94259]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:26 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 Nov 04 22:30:26 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Acquiring lock "cinder-2e37bf1c-06f4-4388-8267-061a24560a12-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:27 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "cinder-2e37bf1c-06f4-4388-8267-061a24560a12-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728" returned: 0 in 0.453s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728 Nov 04 22:30:27 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Acquiring lock "cinder-quobyte-2e37bf1c-06f4-4388-8267-061a24560a12" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:27 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "cinder-quobyte-2e37bf1c-06f4-4388-8267-061a24560a12" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd 1G" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813c81c-7fab-4eb5-a8bf-a5a35b125543]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd Nov 04 22:30:27 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 Nov 04 22:30:27 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-280e537c-2270-4f29-97b9-8253c0692728" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-280e537c-2270-4f29-97b9-8253c0692728" released by "delete_volume" :: held 0.856s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['97269086-c630-41c3-9621-7fe11e3030a2', '694ed7ea-d80b-4524-8d56-1ec167c97d03', 'e37a3981-684e-4ba6-a01a-67c744024189', 'de63488e-c616-44b8-ad29-9d12cbd5810a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd" returned: 0 in 0.455s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:27 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd is being set with open permissions: ugo+rw Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:27 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd Nov 04 22:30:27 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:27 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12" returned: 0 in 0.568s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:28 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12 Nov 04 22:30:28 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleting offline snapshot a078c8c5-11ac-432c-bfa4-2c7dbaa956ef of volume 3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] snapshot_file for this snap is: volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e633473-6ad4-49d9-bfbf-add140d4525b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:28 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleted volume successfully. Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-575acff2-6aba-432a-93dd-3b2d052961c2 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-280e537c-2270-4f29-97b9-8253c0692728-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:28 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd" returned: 0 in 0.422s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:28 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:28 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1bf189b3-e9dc-4d1f-bb17-65dfd1bab0aa tempest-SnapshotsActionsTest-37754386 None] Create snapshot completed successfully Nov 04 22:30:28 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2e37bf1c-06f4-4388-8267-061a24560a12" returned: 0 in 0.430s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "cinder-quobyte-2e37bf1c-06f4-4388-8267-061a24560a12" released by "delete_volume" :: held 1.075s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Created reservations ['5ac2a908-8801-43e9-af55-b7583fc1c009', 'ce372b84-28a2-491c-976d-faf077cd981f', 'e785ef9d-7cb8-48f6-b2d0-025b6a3e407e', '37f0873f-d3ff-4760-bc9b-f6910ec2c0e2'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:28 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.453s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c62faa6-a99f-40d2-9b74-20f102f744d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:28 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:28 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81cc48a-30f5-40b9-aa0a-5d93b3cfaf3d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:28 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:28 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:28 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.304s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Deleted volume successfully. Nov 04 22:30:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-666ab217-cd1b-4517-924c-07fca3e61a82 tempest-ProjectReaderTests-1499820989 None] Lock "cinder-2e37bf1c-06f4-4388-8267-061a24560a12-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-c23b54b0-2b87-4772-a94e-4adea898c4fd-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-c23b54b0-2b87-4772-a94e-4adea898c4fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Acquiring lock "cinder-quobyte-c23b54b0-2b87-4772-a94e-4adea898c4fd" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-c23b54b0-2b87-4772-a94e-4adea898c4fd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Deleting offline snapshot c23b54b0-2b87-4772-a94e-4adea898c4fd of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] snapshot_file for this snap is: volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094e0eb-ffdf-4105-82f5-1acbfbd41572]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:29 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.656s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:29 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd Nov 04 22:30:29 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:29 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:29 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:29 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd" returned: 0 in 0.489s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d793730a-9841-4afb-b6fd-8e01f9328506]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:29 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.459s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:29 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef Nov 04 22:30:29 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:29 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:29 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:30 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5.a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef" released by "_delete_snapshot" :: held 2.113s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" released by "delete_snapshot" :: held 2.143s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:30 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.504s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['dc341b2b-ee40-4c00-b9ea-67364ca7e4dc', 'f21c3e85-85e6-4fed-b83e-6b815d509c6a', 'a119714e-cb78-4e86-ae80-3ddeb1bd350b', '042f70a3-9bf4-4f2f-ab41-42754e41f31c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:30 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd Nov 04 22:30:30 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Delete snapshot completed successfully. Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-dcf706dc-b96e-4c80-b867-4cf9cd726633 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-a078c8c5-11ac-432c-bfa4-2c7dbaa956ef-delete_snapshot" released by "delete_snapshot" :: held 2.377s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:30 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd" returned: 0 in 0.499s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:30 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd Nov 04 22:30:30 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:31 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c23b54b0-2b87-4772-a94e-4adea898c4fd" returned: 0 in 0.304s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-c23b54b0-2b87-4772-a94e-4adea898c4fd" released by "_delete_snapshot" :: held 1.961s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_snapshot" :: held 1.988s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Created reservations ['df35fed4-7f73-431b-90e7-a6f0e998a4a9', '15bd64c2-c369-47c7-96a8-a8a1f6e52fc7', '140d9503-484f-46fd-9d52-b9b86581c81d', 'd907bc59-e954-4bf9-8630-88d874b5dee7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-3c62faa6-a99f-40d2-9b74-20f102f744d5-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Delete snapshot completed successfully. Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-3c62faa6-a99f-40d2-9b74-20f102f744d5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f287daa7-5c04-48d4-9e22-c6f0bacc629f tempest-SnapshotsActionsTest-1985017930 None] Lock "cinder-c23b54b0-2b87-4772-a94e-4adea898c4fd-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[97295a62-ae67-4120-a228-7ef8d9d86e32]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:31 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:31 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:31 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.429s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:31 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5 Nov 04 22:30:31 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:32 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3c62faa6-a99f-40d2-9b74-20f102f744d5" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-3c62faa6-a99f-40d2-9b74-20f102f744d5" released by "delete_volume" :: held 0.817s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['54aab26e-9c6c-4a90-8573-6cb60614f9c4', '92468b01-ec9b-4200-a9bb-3118fd98906e', 'b233c9f2-2754-4421-bae4-4438002609ac', '61fdd60e-bc66-4254-a23d-791a5f30e780'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:32 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:32 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:32 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.442s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:32 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleted volume successfully. Nov 04 22:30:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-040c813a-1477-45af-9a9e-c678d7d37ca5 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-3c62faa6-a99f-40d2-9b74-20f102f744d5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2554e6c8-8580-4996-95c2-e9a16eb80ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4cca00-62fd-49e0-9750-b923be81f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "cinder-c7a4b72a-532a-4a8d-acde-79eb30984cc9-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4cca00-62fd-49e0-9750-b923be81f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-692278305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:33Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e99e6-58c5-42fc-8bab-b10992af9f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e99e6-58c5-42fc-8bab-b10992af9f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a49219c-2d13-4f3b-b06b-74e53f92a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a49219c-2d13-4f3b-b06b-74e53f92a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac', 'volume_name': 'volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f0147b-abe0-4bae-934c-dc4ad1964ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f0147b-abe0-4bae-934c-dc4ad1964ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0711b81-1345-4b24-a1ed-b11ad5c144f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:33 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac', 'volume_size': 1} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-692278305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:33Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating volume bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:33 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:33 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac 1073741824 Nov 04 22:30:33 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-c7a4b72a-532a-4a8d-acde-79eb30984cc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.145s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "cinder-quobyte-c7a4b72a-532a-4a8d-acde-79eb30984cc9" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-c7a4b72a-532a-4a8d-acde-79eb30984cc9" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Deleting offline snapshot c7a4b72a-532a-4a8d-acde-79eb30984cc9 of volume cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] snapshot_file for this snap is: volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdde6ba-dfc9-4b87-bf89-4fe2f398f86d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:33 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:33 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:34 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac 1073741824" returned: 0 in 0.649s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:34 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.553s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:34 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:34 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e523d41-16f2-48db-8578-aa27584959cd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:34 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 Nov 04 22:30:34 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:34 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0711b81-1345-4b24-a1ed-b11ad5c144f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2ed15a-faed-4495-a00f-c742c1d26e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:34 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac (bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac): created successfully Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2ed15a-faed-4495-a00f-c742c1d26e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2554e6c8-8580-4996-95c2-e9a16eb80ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7c97048a-cdeb-49cb-bc10-e8686c46dda4 tempest-VolumesSnapshotTestJSON-1879738912 None] Created volume successfully. Nov 04 22:30:34 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:34 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:34 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:35 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.414s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:35 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9 Nov 04 22:30:35 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:35 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97.c7a4b72a-532a-4a8d-acde-79eb30984cc9" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-c7a4b72a-532a-4a8d-acde-79eb30984cc9" released by "_delete_snapshot" :: held 2.000s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_snapshot" :: held 2.040s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Created reservations ['7d80e779-4219-431b-a279-d2970c714acf', '953f2e24-cbfe-40a3-9407-f92b347addba', '6934cee2-0337-411e-a073-8709dc29c168', 'bb73d310-58f1-4380-82ff-92ddf9bd059b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Delete snapshot completed successfully. Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c2df035e-8a21-4f1f-b512-aa31d07e10f1 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-c7a4b72a-532a-4a8d-acde-79eb30984cc9-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Creating offline snapshot b17782c2-0ae8-4431-baf5-69e994eef33c of volume bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[431907cd-6ee5-45ab-b48c-f903297e4a1d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:35 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:35 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:36 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.465s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:36 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c 1G Nov 04 22:30:36 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "cinder-cd476851-3dc6-4ac8-aaa3-9c4c428edb97-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-cd476851-3dc6-4ac8-aaa3-9c4c428edb97-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67fd5e-ef13-4989-9279-ad6461bb5218]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:37 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c 1G" returned: 0 in 0.673s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:37 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:37 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:37 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 Nov 04 22:30:37 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:37 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:37 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c is being set with open permissions: ugo+rw Nov 04 22:30:37 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" returned: 0 in 0.479s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:37 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:37 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:37 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97 Nov 04 22:30:37 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:37 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" returned: 0 in 0.328s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-quobyte-cd476851-3dc6-4ac8-aaa3-9c4c428edb97" released by "delete_volume" :: held 0.909s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:37 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:37 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Created reservations ['a296ba4c-6732-4027-b779-da4655a1b028', '4c7f22ec-a97d-44b0-9abe-ece4661a5ffa', 'e449c0c4-f48e-44b7-9eed-4242f3145293', 'cf13179d-5760-49f5-a523-417683335d4d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:37 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info Nov 04 22:30:37 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:38 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:38 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:38 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:38 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info is being set with open permissions: ugo+rw Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:38 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info Nov 04 22:30:38 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:38 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Deleted volume successfully. Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-62840ca9-aaa5-4c80-996d-18cce8ec9f86 tempest-SnapshotsActionsTest-37754386 None] Lock "cinder-cd476851-3dc6-4ac8-aaa3-9c4c428edb97-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:38 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.info" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e53731af-3fd4-4a96-a1de-af2472bc252c tempest-VolumesSnapshotTestJSON-1879738912 None] Create snapshot completed successfully Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2d111372-3d1d-4d92-8a6d-9b0d70a1bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3674acf3-af42-4dad-879a-4c026d4b277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3674acf3-af42-4dad-879a-4c026d4b277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-552007197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fa6ce3-ed9c-4dca-aff0-b951135f374b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f956272083d04ae8806379a5fbc53bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b17782c2-0ae8-4431-baf5-69e994eef33c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:40Z,use_quota=True,user_id='233f88f85ef943ebae3a3aa154133712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fadb43-88fa-4ccf-ac1f-1643afe6deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fadb43-88fa-4ccf-ac1f-1643afe6deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251f52d-fd13-4e2a-a38a-79be4c288c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251f52d-fd13-4e2a-a38a-79be4c288c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33fa6ce3-ed9c-4dca-aff0-b951135f374b', 'volume_name': 'volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b', 'volume_size': 1, 'snapshot_id': 'b17782c2-0ae8-4431-baf5-69e994eef33c'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c2dc41-40c5-439d-8c5d-def72625cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c2dc41-40c5-439d-8c5d-def72625cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbe5464-ea8c-47fc-b310-1137dd189e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume 33fa6ce3-ed9c-4dca-aff0-b951135f374b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b', 'volume_size': 1, 'snapshot_id': 'b17782c2-0ae8-4431-baf5-69e994eef33c'} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c-33fa6ce3-ed9c-4dca-aff0-b951135f374b" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c-33fa6ce3-ed9c-4dca-aff0-b951135f374b" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating volume 33fa6ce3-ed9c-4dca-aff0-b951135f374b from snapshot b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] snapshot: b17782c2-0ae8-4431-baf5-69e994eef33c, volume: 33fa6ce3-ed9c-4dca-aff0-b951135f374b, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[930271e5-d728-41d8-a1b2-ae0e1cc9e063]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:40 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:40 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:40 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e6e2d-ce46-497b-a86f-e370344910c9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:40 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:40 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:41 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:30:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:30:41 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:30:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:41 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b Nov 04 22:30:41 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Flow 'volume_create_manager' (fc064137-a5f9-4fa1-b062-a0c77a26a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fedc9d-876b-4083-987b-3ed4044c5e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fedc9d-876b-4083-987b-3ed4044c5e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1722188056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06a8af6-6234-4f4d-bfbb-3c6bacd97e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223aaf1f5f174642a1c4d7a68f4f5f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:45Z,use_quota=True,user_id='2636593f688640d2a178559c88b9529b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ddd31-c93c-4e1a-b86c-d70d1b537ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ddd31-c93c-4e1a-b86c-d70d1b537ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0132c3-b5cc-4218-8f2b-e87e12c154f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0132c3-b5cc-4218-8f2b-e87e12c154f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06a8af6-6234-4f4d-bfbb-3c6bacd97e99', 'volume_name': 'volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a835f140-1d83-4a27-98f5-812e2c5c64e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a835f140-1d83-4a27-98f5-812e2c5c64e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9c8214-a22c-4473-9d87-22615e55b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Volume e06a8af6-6234-4f4d-bfbb-3c6bacd97e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99', 'volume_size': 1} Nov 04 22:30:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:50 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b" returned: 0 in 8.868s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:30:50 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Converted 1024.00 MB image at 115.46 MB/s Nov 04 22:30:50 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b is being set with open permissions: ugo+rw Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:50 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b Nov 04 22:30:50 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=132,cinder:UPDATE=149,cinder:INSERT=48,cinder:DELETE=7 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:30:50 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b" returned: 0 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" released by "_copy_volume_from_snapshot" :: held 10.321s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c-33fa6ce3-ed9c-4dca-aff0-b951135f374b" released by "_create_volume_from_snapshot" :: held 10.454s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.475s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1722188056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06a8af6-6234-4f4d-bfbb-3c6bacd97e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223aaf1f5f174642a1c4d7a68f4f5f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:30:45Z,use_quota=True,user_id='2636593f688640d2a178559c88b9529b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Creating volume e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:30:50 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:50 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 1073741824 Nov 04 22:30:50 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbe5464-ea8c-47fc-b310-1137dd189e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b', 'volume_size': 1, 'snapshot_id': 'b17782c2-0ae8-4431-baf5-69e994eef33c'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc4354d-fbda-4de8-8a04-b63f39d9b427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Volume volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b (33fa6ce3-ed9c-4dca-aff0-b951135f374b): created successfully Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc4354d-fbda-4de8-8a04-b63f39d9b427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Flow 'volume_create_manager' (2d111372-3d1d-4d92-8a6d-9b0d70a1bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-df20679b-30bc-40b7-a1df-a3bf2dcc4ec6 tempest-VolumesSnapshotTestJSON-1879738912 None] Created volume successfully. Nov 04 22:30:51 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 1073741824" returned: 0 in 0.644s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-33fa6ce3-ed9c-4dca-aff0-b951135f374b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-33fa6ce3-ed9c-4dca-aff0-b951135f374b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:51 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:30:51 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622a027-9c8d-45ab-88c7-a238c9856a6d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:51 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b Nov 04 22:30:51 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:51 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.387s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9c8214-a22c-4473-9d87-22615e55b03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f37f47-5d22-4a8a-ab1d-c7867dddf198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Volume volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 (e06a8af6-6234-4f4d-bfbb-3c6bacd97e99): created successfully Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f37f47-5d22-4a8a-ab1d-c7867dddf198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Flow 'volume_create_manager' (fc064137-a5f9-4fa1-b062-a0c77a26a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0a3f9f90-8777-4b0e-8033-f502323f7e7f tempest-TestStampPattern-698249012 None] Created volume successfully. Nov 04 22:30:51 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b" returned: 0 in 0.474s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:51 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b Nov 04 22:30:51 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:52 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-33fa6ce3-ed9c-4dca-aff0-b951135f374b" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-33fa6ce3-ed9c-4dca-aff0-b951135f374b" released by "delete_volume" :: held 0.827s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['9cd1c638-daae-4cb9-8643-d8506add1541', '229744b5-fa7b-423e-8535-2927b5bcf72c', '6efa230a-0272-474a-b7c0-98fa2ae2a8da', '7b1c6dc2-63f9-4ea7-b95c-ca4ab8f57daf'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:52 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:52 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-b17782c2-0ae8-4431-baf5-69e994eef33c-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-b17782c2-0ae8-4431-baf5-69e994eef33c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleting offline snapshot b17782c2-0ae8-4431-baf5-69e994eef33c of volume bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] snapshot_file for this snap is: volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b74b3-1482-49b3-8fad-6aa52848a76a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:52 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Deleted volume successfully. Nov 04 22:30:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-21ee78b2-17c1-41e7-a401-e1b8ef049eac tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-33fa6ce3-ed9c-4dca-aff0-b951135f374b-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:52 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:52 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:53 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.517s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:30:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6d58f-8797-4136-824d-4cbe2e7b73cb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:53 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:53 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:54 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.881s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:54 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:54 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:54 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.673s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:54 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c Nov 04 22:30:54 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:55 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac.b17782c2-0ae8-4431-baf5-69e994eef33c" returned: 0 in 0.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-b17782c2-0ae8-4431-baf5-69e994eef33c" released by "_delete_snapshot" :: held 2.692s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" released by "delete_snapshot" :: held 2.718s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:55 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['ed853e07-c8e8-4722-87be-9862b607ff16', '14c363bb-e4dc-43df-978a-9c4c59017675', '0d775ce4-e5e0-4a13-99d4-0c2fc3093de9', '58ee3033-fe35-4a88-8843-21fb1a8f1a21'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Delete snapshot completed successfully. Nov 04 22:30:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63da3877-7c74-415c-be08-d5232ec70650 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-b17782c2-0ae8-4431-baf5-69e994eef33c-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8118755f-4538-4f89-bbbf-4daa5d6ae70a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:56 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:56 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:56 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:56 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:56 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.526s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:56 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac Nov 04 22:30:56 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:56 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:30:57 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" returned: 0 in 0.311s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac" released by "delete_volume" :: held 0.939s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['d41b672b-25ae-4454-bb07-0ccefb0a9a50', '62dab85b-46f9-4199-884f-2aa22a366919', '0947f376-4068-4e1b-9538-c32376fb7575', 'fccbe601-d318-4bb2-a7c4-33c83dd9b2a3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:57 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:57 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:57 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.305s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:30:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleted volume successfully. Nov 04 22:30:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b3e628f9-55bd-461e-9f46-c18ded5cc780 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-bf8615fe-8bc0-49cb-ae8c-59a3e6f9b3ac-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c1041-512f-45ae-886a-cb3979d1a631]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:30:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:58 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 Nov 04 22:30:58 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:59 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" returned: 0 in 0.465s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:59 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41 Nov 04 22:30:59 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:59 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-quobyte-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41" released by "delete_volume" :: held 0.907s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Created reservations ['f2a2f030-d447-4764-b17b-35125a2836bf', 'ee27cc84-7bda-4323-ae5f-97671a650953', '1415130f-2f4c-4bbf-8f31-f8f13ad0bbb1', 'f2acf1c3-d41d-4a70-bd70-d3b9d49c7f1a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:30:59 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:30:59 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Flow 'volume_create_manager' (ae16008e-1a74-4624-9333-a6c384642b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea62dbc-4fe4-4cb3-b81a-10944b621c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea62dbc-4fe4-4cb3-b81a-10944b621c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1895374230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ccb7c-7302-40f1-95eb-cd5d76392012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3961ec0590a42f680cec21d450c0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:00Z,use_quota=True,user_id='e03c4533ee004d8191a7be115c7d74d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e776bad2-0343-443e-81e9-cff71720380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e776bad2-0343-443e-81e9-cff71720380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331ee02a-7a9f-4d61-b15c-c8663399fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331ee02a-7a9f-4d61-b15c-c8663399fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6ccb7c-7302-40f1-95eb-cd5d76392012', 'volume_name': 'volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3237ea-284b-42ff-b8bf-5c00f78b32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3237ea-284b-42ff-b8bf-5c00f78b32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55bbc75-9796-4f48-a434-b39fdd968126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:30:59 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume 1f6ccb7c-7302-40f1-95eb-cd5d76392012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012', 'volume_size': 1} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1895374230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ccb7c-7302-40f1-95eb-cd5d76392012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3961ec0590a42f680cec21d450c0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:00Z,use_quota=True,user_id='e03c4533ee004d8191a7be115c7d74d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Creating volume 1f6ccb7c-7302-40f1-95eb-cd5d76392012 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:30:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:31:00 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:00 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.328s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:31:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Deleted volume successfully. Nov 04 22:31:00 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 1073741824 Nov 04 22:31:00 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2cce0c8-2bff-4bba-a2ec-9dfa78dc3b98 tempest-VolumesSnapshotTestJSON-1879738912 None] Lock "cinder-d64a56d6-3f4e-49ff-a5d4-8637d9d55a41-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:00 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 1073741824" returned: 0 in 0.469s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:00 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 Nov 04 22:31:00 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:00 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012" returned: 0 in 0.336s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55bbc75-9796-4f48-a434-b39fdd968126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfcf80b-8eee-4d90-9b34-8aad29fb27b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 (1f6ccb7c-7302-40f1-95eb-cd5d76392012): created successfully Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfcf80b-8eee-4d90-9b34-8aad29fb27b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Flow 'volume_create_manager' (ae16008e-1a74-4624-9333-a6c384642b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6d0cfdae-13b3-427f-8e54-fc4157808000 tempest-VolumeQuotasAdminTestJSON-180044035 None] Created volume successfully. Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "cinder-1f6ccb7c-7302-40f1-95eb-cd5d76392012-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "cinder-1f6ccb7c-7302-40f1-95eb-cd5d76392012-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "cinder-quobyte-1f6ccb7c-7302-40f1-95eb-cd5d76392012" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "cinder-quobyte-1f6ccb7c-7302-40f1-95eb-cd5d76392012" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56afa5-fcdb-4ea0-aaa7-b1ee60f6e1cc]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:02 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 Nov 04 22:31:02 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:02 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012" returned: 0 in 0.547s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:02 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012 Nov 04 22:31:02 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:03 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-1f6ccb7c-7302-40f1-95eb-cd5d76392012" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "cinder-quobyte-1f6ccb7c-7302-40f1-95eb-cd5d76392012" released by "delete_volume" :: held 0.856s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Created reservations ['47e5ae56-d726-4501-b3ee-bfd454cc22a7', '7d8fccf7-b4e0-4ec0-acba-c8961f7c11c5', '05eb44b1-8623-4fc5-8768-da3bc7e728b8', 'c0793ddd-f7fa-4c92-8228-1c0179d20bc2'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:03 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:31:03 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:03 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:31:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Deleted volume successfully. Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b06cfacf-4741-4cf6-936c-44e2f2fba24b tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "cinder-1f6ccb7c-7302-40f1-95eb-cd5d76392012-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:03 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Flow 'volume_create_manager' (5ac98fd8-8e60-4644-a223-b076f9ca6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a48f90-b504-4c96-8eae-fbcccdfd7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a48f90-b504-4c96-8eae-fbcccdfd7aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-854539715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38378cc4-40c3-4a9f-9429-6824cda7a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3961ec0590a42f680cec21d450c0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:04Z,use_quota=True,user_id='e03c4533ee004d8191a7be115c7d74d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042fcb33-cf2a-46da-8b27-e65176a285bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042fcb33-cf2a-46da-8b27-e65176a285bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a929fe-f3ed-4c86-a23f-81b984d591b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a929fe-f3ed-4c86-a23f-81b984d591b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38378cc4-40c3-4a9f-9429-6824cda7a04a', 'volume_name': 'volume-38378cc4-40c3-4a9f-9429-6824cda7a04a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef5b06-08a5-44ed-a8a9-96a7a50b2c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef5b06-08a5-44ed-a8a9-96a7a50b2c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c457733-11fa-4399-b7ef-47541bb8c9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume 38378cc4-40c3-4a9f-9429-6824cda7a04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38378cc4-40c3-4a9f-9429-6824cda7a04a', 'volume_size': 1} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-854539715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38378cc4-40c3-4a9f-9429-6824cda7a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3961ec0590a42f680cec21d450c0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:04Z,use_quota=True,user_id='e03c4533ee004d8191a7be115c7d74d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Creating volume 38378cc4-40c3-4a9f-9429-6824cda7a04a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:31:04 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:04 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a 1073741824 Nov 04 22:31:04 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:04 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a 1073741824" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:04 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a Nov 04 22:31:04 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:04 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a" returned: 0 in 0.260s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c457733-11fa-4399-b7ef-47541bb8c9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38378cc4-40c3-4a9f-9429-6824cda7a04a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbdc50d-64c0-45f7-963d-119371242072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:04 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Volume volume-38378cc4-40c3-4a9f-9429-6824cda7a04a (38378cc4-40c3-4a9f-9429-6824cda7a04a): created successfully Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbdc50d-64c0-45f7-963d-119371242072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Flow 'volume_create_manager' (5ac98fd8-8e60-4644-a223-b076f9ca6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0323a86f-a4a0-4a62-b41d-9ec83bf25565 tempest-VolumeQuotasAdminTestJSON-180044035 None] Created volume successfully. Nov 04 22:31:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7624ad2c-6de8-4792-8973-032fa57c7f96 tempest-VolumeQuotasAdminTestJSON-142352501 None] Transfer volume completed successfully. Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Acquiring lock "cinder-38378cc4-40c3-4a9f-9429-6824cda7a04a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "cinder-38378cc4-40c3-4a9f-9429-6824cda7a04a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Acquiring lock "cinder-quobyte-38378cc4-40c3-4a9f-9429-6824cda7a04a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "cinder-quobyte-38378cc4-40c3-4a9f-9429-6824cda7a04a" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8b447-92ba-4176-8b8a-d4c3cc7ce440]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:07 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a Nov 04 22:31:07 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:08 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:08 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a Nov 04 22:31:08 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:08 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-38378cc4-40c3-4a9f-9429-6824cda7a04a" returned: 0 in 0.278s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "cinder-quobyte-38378cc4-40c3-4a9f-9429-6824cda7a04a" released by "delete_volume" :: held 0.794s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Created reservations ['d2c5d8ed-c725-4eba-9e95-84f8b0344b7c', '36361812-aba7-46ce-98a5-a0bd12313a74', '1f6a23a6-94f8-4ed9-835e-73b43f7f2bd7', '61db1ce9-4ba1-462e-8b2a-ff608ea3de7c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:08 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:31:08 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:08 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.285s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:31:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Deleted volume successfully. Nov 04 22:31:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4a987d23-da9d-4580-b17c-e7609ab7941e tempest-VolumeQuotasAdminTestJSON-172551727 None] Lock "cinder-38378cc4-40c3-4a9f-9429-6824cda7a04a-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:18 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=52,cinder:SELECT=39,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:31:18 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=111,cinder:INSERT=34,cinder:DELETE=12,cinder:UPDATE=149 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:31:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-d9d42afc-39af-4c88-82e6-667e3ca4d68d req-303562cb-41f5-4f6a-b0ab-08a925aaa77c tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-d9d42afc-39af-4c88-82e6-667e3ca4d68d req-303562cb-41f5-4f6a-b0ab-08a925aaa77c tempest-TestStampPattern-698249012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-d9d42afc-39af-4c88-82e6-667e3ca4d68d req-303562cb-41f5-4f6a-b0ab-08a925aaa77c tempest-TestStampPattern-698249012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-d9d42afc-39af-4c88-82e6-667e3ca4d68d req-303562cb-41f5-4f6a-b0ab-08a925aaa77c tempest-TestStampPattern-698249012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d671290-548b-4fdd-beb3-266bfc87b50f', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:31:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-d9d42afc-39af-4c88-82e6-667e3ca4d68d req-303562cb-41f5-4f6a-b0ab-08a925aaa77c tempest-TestStampPattern-698249012 None] attachment_update completed successfully. Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Flow 'volume_create_manager' (b8205691-5bfe-49ba-b7ee-0f50ec0b8f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fedf606-7d69-41a2-9156-92cb94f30653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fedf606-7d69-41a2-9156-92cb94f30653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-917594011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0514797-f6c6-4f2b-a877-655fcf61d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c06c9b95a145c2b84dc90ee99b5774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:23Z,use_quota=True,user_id='f230380cf5434e69ac0a69027503c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c6211b1-d662-47fd-8191-6d45ec4e6f67),volume_type_id=7c6211b1-d662-47fd-8191-6d45ec4e6f67)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04158cc7-362d-476d-b2d0-7dbdce404152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04158cc7-362d-476d-b2d0-7dbdce404152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a93f960-7258-4a28-9157-4ffe7b5c5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a93f960-7258-4a28-9157-4ffe7b5c5f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0514797-f6c6-4f2b-a877-655fcf61d426', 'volume_name': 'volume-c0514797-f6c6-4f2b-a877-655fcf61d426', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5f9510-6101-49b9-9fc0-6821ab23cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5f9510-6101-49b9-9fc0-6821ab23cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8214ac85-096c-4aec-9345-afd0c0aaf8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Volume c0514797-f6c6-4f2b-a877-655fcf61d426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0514797-f6c6-4f2b-a877-655fcf61d426', 'volume_size': 1} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-917594011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0514797-f6c6-4f2b-a877-655fcf61d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c06c9b95a145c2b84dc90ee99b5774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:23Z,use_quota=True,user_id='f230380cf5434e69ac0a69027503c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c6211b1-d662-47fd-8191-6d45ec4e6f67),volume_type_id=7c6211b1-d662-47fd-8191-6d45ec4e6f67)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Creating volume c0514797-f6c6-4f2b-a877-655fcf61d426 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:31:23 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:31:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:23 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 1073741824 Nov 04 22:31:23 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:24 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 1073741824" returned: 0 in 0.495s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:24 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 Nov 04 22:31:24 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:24 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8214ac85-096c-4aec-9345-afd0c0aaf8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0514797-f6c6-4f2b-a877-655fcf61d426', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc5ef8a-18a2-4add-b4bc-21e9542f6d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:24 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Volume volume-c0514797-f6c6-4f2b-a877-655fcf61d426 (c0514797-f6c6-4f2b-a877-655fcf61d426): created successfully Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc5ef8a-18a2-4add-b4bc-21e9542f6d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Flow 'volume_create_manager' (b8205691-5bfe-49ba-b7ee-0f50ec0b8f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6fd4572f-4f4f-41bc-b42c-d8b44eb788f0 tempest-VolumeTypesAccessTest-612262569 None] Created volume successfully. Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Acquiring lock "cinder-c0514797-f6c6-4f2b-a877-655fcf61d426-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "cinder-c0514797-f6c6-4f2b-a877-655fcf61d426-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Acquiring lock "cinder-quobyte-c0514797-f6c6-4f2b-a877-655fcf61d426" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "cinder-quobyte-c0514797-f6c6-4f2b-a877-655fcf61d426" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8012a-502a-44e6-81a9-2c1b54d1a740]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:26 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 Nov 04 22:31:26 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:26 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426" returned: 0 in 0.464s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:26 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426 Nov 04 22:31:26 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:26 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c0514797-f6c6-4f2b-a877-655fcf61d426" returned: 0 in 0.323s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "cinder-quobyte-c0514797-f6c6-4f2b-a877-655fcf61d426" released by "delete_volume" :: held 0.853s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:26 devstack cinder-volume[87173]: WARNING cinder.quota [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1780779167 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1780779167, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:31:26 devstack cinder-volume[87173]: WARNING cinder.quota [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1780779167 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1780779167, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Created reservations ['6c7c66f0-0bda-496b-86ba-d4710fa23275', '760298ad-ce1a-4c25-beba-aa1e5488b354', 'cc0b63b5-a417-49b3-b11b-657d107c5da5', 'b803510c-a569-4061-b731-4894cbcc2cd1'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:26 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:31:26 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:27 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.317s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:27 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:31:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Deleted volume successfully. Nov 04 22:31:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0c71f4-237e-48e7-8f42-6d5de0daeb26 tempest-VolumeTypesAccessTest-612262569 None] Lock "cinder-c0514797-f6c6-4f2b-a877-655fcf61d426-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-9ca1cb85-ec39-4249-ab6b-154581ee3139 req-c071a507-e5e7-4934-a6ee-7428481f4346 tempest-TestStampPattern-698249012 None] Terminate volume connection completed successfully. Nov 04 22:31:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-9ca1cb85-ec39-4249-ab6b-154581ee3139 req-c071a507-e5e7-4934-a6ee-7428481f4346 tempest-TestStampPattern-698249012 None] Deleting attachment 5d671290-548b-4fdd-beb3-266bfc87b50f. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Creating offline snapshot e17f7e80-8e60-409f-b87b-d48d109e772e of volume e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76be64-2d40-401a-b6d3-0f8acfbc87ba]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:29 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:31:29 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:29 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.459s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:29 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e 1G Nov 04 22:31:29 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:30 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e 1G" returned: 0 in 0.564s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:30 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:31:30 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:30 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.349s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:30 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e is being set with open permissions: ugo+rw Nov 04 22:31:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:30 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:31:30 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:31 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:31 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info Nov 04 22:31:31 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:31 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info" returned: 0 in 0.316s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:31 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info is being set with open permissions: ugo+rw Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:31 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info Nov 04 22:31:31 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:31 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.info" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5dfbf178-f700-4258-819e-41588bd8c7d9 tempest-TestStampPattern-698249012 None] Create snapshot completed successfully Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Flow 'volume_create_manager' (c304e1f9-52fc-48e5-bd4d-3ebd93e445ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d18262d-9e29-46bc-92c1-bb30df9f4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d18262d-9e29-46bc-92c1-bb30df9f4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1983685196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50545c2d-ed5d-4f54-88d9-61388c3ed1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223aaf1f5f174642a1c4d7a68f4f5f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e17f7e80-8e60-409f-b87b-d48d109e772e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:42Z,use_quota=True,user_id='2636593f688640d2a178559c88b9529b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a47aef-a9a3-4c8c-9b24-e83b8162f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a47aef-a9a3-4c8c-9b24-e83b8162f87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4739d4f5-dc55-4873-99fe-4abca3b9c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4739d4f5-dc55-4873-99fe-4abca3b9c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50545c2d-ed5d-4f54-88d9-61388c3ed1c8', 'volume_name': 'volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8', 'volume_size': 1, 'snapshot_id': 'e17f7e80-8e60-409f-b87b-d48d109e772e'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b728aa4d-c4ca-4c2f-82e9-cd3f50502b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b728aa4d-c4ca-4c2f-82e9-cd3f50502b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e17874-b314-415c-9f7e-fb1b8948fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:42 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Volume 50545c2d-ed5d-4f54-88d9-61388c3ed1c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8', 'volume_size': 1, 'snapshot_id': 'e17f7e80-8e60-409f-b87b-d48d109e772e'} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Creating volume 50545c2d-ed5d-4f54-88d9-61388c3ed1c8 from snapshot e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] snapshot: e17f7e80-8e60-409f-b87b-d48d109e772e, volume: 50545c2d-ed5d-4f54-88d9-61388c3ed1c8, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5215ce54-6e89-4fc2-971b-32cda34ac64a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:42 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:31:42 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:43 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.580s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:31:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de9f2e3-d519-4c65-8015-445e9f3bff27]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:31:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:43 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:31:43 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:43 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:43 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Flow 'volume_create_manager' (b1613532-b40f-444d-9031-93f90392caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff91895-a84f-4055-bd2f-b342bad000a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.868s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff91895-a84f-4055-bd2f-b342bad000a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1402273411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d6d022-2765-4fa2-9c92-6424186ae423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf35d32e76a4500968d7cd412c83c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:44Z,use_quota=True,user_id='0011ffc91e8142898ec0feeb5c806c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23031de-17bb-4585-862f-322fc8c4603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:44 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 Nov 04 22:31:44 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23031de-17bb-4585-862f-322fc8c4603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8698261e-258f-4ab7-9f63-df65833fb893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8698261e-258f-4ab7-9f63-df65833fb893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d6d022-2765-4fa2-9c92-6424186ae423', 'volume_name': 'volume-85d6d022-2765-4fa2-9c92-6424186ae423', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c78cb6-3f6e-4e4e-aa26-6eb259a1cb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c78cb6-3f6e-4e4e-aa26-6eb259a1cb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524a311b-f9cc-4a96-b53a-9781b2ad2b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Volume 85d6d022-2765-4fa2-9c92-6424186ae423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d6d022-2765-4fa2-9c92-6424186ae423', 'volume_size': 1} Nov 04 22:31:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:52 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=21,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:31:54 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:31:56 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" returned: 0 in 12.425s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99, size 1024.00 MB, duration 12.43 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:31:56 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Converted 1024.00 MB image at 82.40 MB/s Nov 04 22:31:56 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 is being set with open permissions: ugo+rw Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:56 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 Nov 04 22:31:56 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:56 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:31:56 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:57 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" returned: 0 in 0.549s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" released by "_copy_volume_from_snapshot" :: held 14.655s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" released by "_create_volume_from_snapshot" :: held 14.761s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.784s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.942s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1402273411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d6d022-2765-4fa2-9c92-6424186ae423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf35d32e76a4500968d7cd412c83c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:31:44Z,use_quota=True,user_id='0011ffc91e8142898ec0feeb5c806c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Creating volume 85d6d022-2765-4fa2-9c92-6424186ae423 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:31:57 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:57 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.511s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:31:57 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 1073741824 Nov 04 22:31:57 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e17874-b314-415c-9f7e-fb1b8948fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8', 'volume_size': 1, 'snapshot_id': 'e17f7e80-8e60-409f-b87b-d48d109e772e'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf3c79-8786-4b9f-8c21-80dc5ef176b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:57 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Volume volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 (50545c2d-ed5d-4f54-88d9-61388c3ed1c8): created successfully Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf3c79-8786-4b9f-8c21-80dc5ef176b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Flow 'volume_create_manager' (c304e1f9-52fc-48e5-bd4d-3ebd93e445ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-093bb059-9e9f-438b-974a-40a85b7254c9 tempest-TestStampPattern-698249012 None] Created volume successfully. Nov 04 22:31:57 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 1073741824" returned: 0 in 0.856s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:31:58 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 Nov 04 22:31:58 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:31:58 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423" returned: 0 in 0.512s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524a311b-f9cc-4a96-b53a-9781b2ad2b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d6d022-2765-4fa2-9c92-6424186ae423', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4b5124-b563-49df-8957-0abcf9e45826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:31:58 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Volume volume-85d6d022-2765-4fa2-9c92-6424186ae423 (85d6d022-2765-4fa2-9c92-6424186ae423): created successfully Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4b5124-b563-49df-8957-0abcf9e45826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:31:58 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Flow 'volume_create_manager' (b1613532-b40f-444d-9031-93f90392caf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:31:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-974bd841-beb1-48f1-af52-c2185f3613c2 tempest-TestMinimumBasicScenario-658085755 None] Created volume successfully. Nov 04 22:32:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-ae46f3e2-4f8e-4864-b77c-9694a336d39e req-89174730-bad0-48c6-b759-2a208d398d8f tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-ae46f3e2-4f8e-4864-b77c-9694a336d39e req-89174730-bad0-48c6-b759-2a208d398d8f tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-ae46f3e2-4f8e-4864-b77c-9694a336d39e req-89174730-bad0-48c6-b759-2a208d398d8f tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-ae46f3e2-4f8e-4864-b77c-9694a336d39e req-89174730-bad0-48c6-b759-2a208d398d8f tempest-TestMinimumBasicScenario-658085755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-85d6d022-2765-4fa2-9c92-6424186ae423', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26d961df-8aeb-4379-9c17-f518fda51260', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:32:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-ae46f3e2-4f8e-4864-b77c-9694a336d39e req-89174730-bad0-48c6-b759-2a208d398d8f tempest-TestMinimumBasicScenario-658085755 None] attachment_update completed successfully. Nov 04 22:32:10 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:INSERT=2,cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=9 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:32:10 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (b47a18e5-ff8e-4c76-8dfb-2ac3e1d0d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68f67a7-998c-4b02-892b-1fd12df97377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68f67a7-998c-4b02-892b-1fd12df97377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108342701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dda0c8-100e-45d1-a8c6-2949b0d2540f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:26Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b1817-afe1-456b-8f53-8cbc3ae4221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b1817-afe1-456b-8f53-8cbc3ae4221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b23f55c-2e03-4a06-8957-357abd1ea5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b23f55c-2e03-4a06-8957-357abd1ea5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00dda0c8-100e-45d1-a8c6-2949b0d2540f', 'volume_name': 'volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63c519d-1f23-43fc-8e17-a09d33172581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63c519d-1f23-43fc-8e17-a09d33172581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa2257-5cb5-4a8e-b780-8153de36d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:26 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Volume 00dda0c8-100e-45d1-a8c6-2949b0d2540f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f', 'volume_size': 1} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108342701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dda0c8-100e-45d1-a8c6-2949b0d2540f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:26Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Creating volume 00dda0c8-100e-45d1-a8c6-2949b0d2540f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:26 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:26 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f 1073741824 Nov 04 22:32:26 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:27 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f 1073741824" returned: 0 in 0.783s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:27 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f Nov 04 22:32:27 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-afb8a36f-0e83-42f1-8e04-bdd679d06110 req-220f96cd-39e5-4405-8994-7befa41776b2 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:27 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f" returned: 0 in 0.385s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-afb8a36f-0e83-42f1-8e04-bdd679d06110 req-220f96cd-39e5-4405-8994-7befa41776b2 tempest-TestStampPattern-698249012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.156s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-afb8a36f-0e83-42f1-8e04-bdd679d06110 req-220f96cd-39e5-4405-8994-7befa41776b2 tempest-TestStampPattern-698249012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa2257-5cb5-4a8e-b780-8153de36d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1c6fbf-9ab9-4cd9-ad30-3543ed0ea782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:27 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Volume volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f (00dda0c8-100e-45d1-a8c6-2949b0d2540f): created successfully Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1c6fbf-9ab9-4cd9-ad30-3543ed0ea782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (b47a18e5-ff8e-4c76-8dfb-2ac3e1d0d317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-44dabefd-1b76-463b-8b18-0f82f6d3aa30 tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-afb8a36f-0e83-42f1-8e04-bdd679d06110 req-220f96cd-39e5-4405-8994-7befa41776b2 tempest-TestStampPattern-698249012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3390d180-c8a4-41df-b0f1-388f96c11103', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:32:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-afb8a36f-0e83-42f1-8e04-bdd679d06110 req-220f96cd-39e5-4405-8994-7befa41776b2 tempest-TestStampPattern-698249012 None] attachment_update completed successfully. Nov 04 22:32:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f2cf1b31-4c86-41e9-b8d4-bc9540e8fb4e tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f" by "attach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f2cf1b31-4c86-41e9-b8d4-bc9540e8fb4e tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f" acquired by "attach_volume" :: waited 0.039s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f2cf1b31-4c86-41e9-b8d4-bc9540e8fb4e tempest-VolumesActionsTest-2039996811 None] Attaching volume 00dda0c8-100e-45d1-a8c6-2949b0d2540f to instance 16d343d8-f4f6-4a6f-8021-c234da3fbf27 at mountpoint /dev/vdb on host None. Nov 04 22:32:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f2cf1b31-4c86-41e9-b8d4-bc9540e8fb4e tempest-VolumesActionsTest-2039996811 None] Attach volume completed successfully. Nov 04 22:32:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f2cf1b31-4c86-41e9-b8d4-bc9540e8fb4e tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f" released by "attach_volume" :: held 0.153s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Terminate volume connection completed successfully. Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" by "detach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Detaching volume 00dda0c8-100e-45d1-a8c6-2949b0d2540f from instance 16d343d8-f4f6-4a6f-8021-c234da3fbf27. Nov 04 22:32:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Detach volume completed successfully. Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8c5a8873-5e0e-4c09-8725-0661f3cb708c tempest-VolumesActionsTest-189651463 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cf99fa61-9470-42d3-947f-006dfa8bff69 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" by "detach_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cf99fa61-9470-42d3-947f-006dfa8bff69 tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-cf99fa61-9470-42d3-947f-006dfa8bff69 tempest-VolumesActionsTest-2039996811 None] Volume detach called, but volume not attached. Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cf99fa61-9470-42d3-947f-006dfa8bff69 tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-quobyte-00dda0c8-100e-45d1-a8c6-2949b0d2540f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "cinder-quobyte-00dda0c8-100e-45d1-a8c6-2949b0d2540f" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63bf63-ce2a-4ccc-b8a8-1e0735c24658]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:30 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f Nov 04 22:32:30 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:30 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f" returned: 0 in 0.431s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:30 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f Nov 04 22:32:30 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:30 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00dda0c8-100e-45d1-a8c6-2949b0d2540f" returned: 0 in 0.376s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "cinder-quobyte-00dda0c8-100e-45d1-a8c6-2949b0d2540f" released by "delete_volume" :: held 0.870s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:30 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Created reservations ['e6fcb240-f920-4ac0-af8b-8efe034a4571', '61ce191d-d6d1-4a1b-a61e-43d7120dbeaf', 'e38aff03-bd45-403f-818e-170795360288', '471493c7-0a6e-41d6-abd3-e86049867148'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:31 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:31 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-1579ffc0-2bdd-4bd8-a38d-531473a48edc req-93f67e9a-2237-4548-b688-42378c6be38c tempest-TestStampPattern-698249012 None] Terminate volume connection completed successfully. Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-1579ffc0-2bdd-4bd8-a38d-531473a48edc req-93f67e9a-2237-4548-b688-42378c6be38c tempest-TestStampPattern-698249012 None] Deleting attachment 3390d180-c8a4-41df-b0f1-388f96c11103. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:32:31 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Deleted volume successfully. Nov 04 22:32:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-005b306a-9b19-47dd-9362-57e2fb62ce5b tempest-VolumesActionsTest-2039996811 None] Lock "cinder-00dda0c8-100e-45d1-a8c6-2949b0d2540f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (9a53b2c4-8e05-45b9-b961-0c11d0c466ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caf3b55-b120-4c07-9017-a1ec80782fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caf3b55-b120-4c07-9017-a1ec80782fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2018078914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5ec66e-3953-4554-9347-be62dfaebefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:36Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a7f54-89b9-4ae1-aab0-fc992c0025ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a7f54-89b9-4ae1-aab0-fc992c0025ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934b284-84ac-423a-985b-63372800317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934b284-84ac-423a-985b-63372800317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5ec66e-3953-4554-9347-be62dfaebefe', 'volume_name': 'volume-fb5ec66e-3953-4554-9347-be62dfaebefe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600fecaf-7a6f-4827-9740-a6793aab8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600fecaf-7a6f-4827-9740-a6793aab8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90f833c-d05b-415b-8896-50af57c0567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:36 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Volume fb5ec66e-3953-4554-9347-be62dfaebefe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5ec66e-3953-4554-9347-be62dfaebefe', 'volume_size': 1} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2018078914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5ec66e-3953-4554-9347-be62dfaebefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:36Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Creating volume fb5ec66e-3953-4554-9347-be62dfaebefe {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:36 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-50545c2d-ed5d-4f54-88d9-61388c3ed1c8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:36 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe 1073741824 Nov 04 22:32:36 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "cinder-50545c2d-ed5d-4f54-88d9-61388c3ed1c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7d221-af73-42df-82c2-d544da511bbf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:36 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 Nov 04 22:32:36 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:37 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe 1073741824" returned: 0 in 0.462s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:37 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe Nov 04 22:32:37 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:37 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" returned: 0 in 0.424s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:37 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8 Nov 04 22:32:37 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:37 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe" returned: 0 in 0.274s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90f833c-d05b-415b-8896-50af57c0567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5ec66e-3953-4554-9347-be62dfaebefe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fb5d31-b749-4bf2-81a3-ecfac0c13611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:37 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Volume volume-fb5ec66e-3953-4554-9347-be62dfaebefe (fb5ec66e-3953-4554-9347-be62dfaebefe): created successfully Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fb5d31-b749-4bf2-81a3-ecfac0c13611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (9a53b2c4-8e05-45b9-b961-0c11d0c466ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-50545c2d-ed5d-4f54-88d9-61388c3ed1c8" released by "delete_volume" :: held 0.770s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-862e4757-a494-4347-99ce-549ec6751899 tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Created reservations ['7586d065-62ab-4815-aedc-e2aa2ae4bf3f', 'c8549c65-03e8-4829-86de-656922a725bd', '5d01ccfb-6264-4bc9-9012-fac892a4a28d', '6e4f6890-a0ac-42a4-899f-cf12ec37e874'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:37 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:37 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:37 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Deleted volume successfully. Nov 04 22:32:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38f4d60c-ee6c-4082-a980-e21e46196d98 tempest-TestStampPattern-698249012 None] Lock "cinder-50545c2d-ed5d-4f54-88d9-61388c3ed1c8-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-e17f7e80-8e60-409f-b87b-d48d109e772e-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-e17f7e80-8e60-409f-b87b-d48d109e772e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Deleting offline snapshot e17f7e80-8e60-409f-b87b-d48d109e772e of volume e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] snapshot_file for this snap is: volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eb3b20-d2a8-4030-9cd8-0b3911106e34]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:38 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:32:38 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:38 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b37ed3-2ca1-478a-94bc-22b70d9df149]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:38 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:32:38 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-fb5ec66e-3953-4554-9347-be62dfaebefe-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "cinder-fb5ec66e-3953-4554-9347-be62dfaebefe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-quobyte-fb5ec66e-3953-4554-9347-be62dfaebefe" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-fb5ec66e-3953-4554-9347-be62dfaebefe" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e5bce-8734-448f-a71d-d72745a78a70]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:39 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe Nov 04 22:32:39 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:39 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.652s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:39 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:32:39 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:39 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe" returned: 0 in 0.456s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:39 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe Nov 04 22:32:39 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:39 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:39 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e Nov 04 22:32:39 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:39 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fb5ec66e-3953-4554-9347-be62dfaebefe" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-fb5ec66e-3953-4554-9347-be62dfaebefe" released by "delete_volume" :: held 0.788s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Created reservations ['56bde9fc-c70e-417b-9aec-39fb52bd3077', 'fdcb5585-8615-442e-85e2-0ad80ffa7fe3', 'eff9fc17-e74b-42a6-a921-896a21500f5a', 'f1193354-4f8b-4f1f-857b-cb66417ac656'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:39 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:39 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:39 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99.e17f7e80-8e60-409f-b87b-d48d109e772e" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e17f7e80-8e60-409f-b87b-d48d109e772e" released by "_delete_snapshot" :: held 1.828s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:39 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" released by "delete_snapshot" :: held 1.857s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Created reservations ['b47394ed-7523-47d8-a4fb-36705ac917b2', '20dd4ea6-f89c-4ddf-b843-d499ace529ba', 'c4969ed7-2a32-4a4f-801d-77540d3b051f', '1bbdd601-3268-4307-aa69-549dbf38255a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Delete snapshot completed successfully. Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-82aaa39a-0f81-4dfd-8785-c0d34225e30d tempest-TestStampPattern-698249012 None] Lock "cinder-e17f7e80-8e60-409f-b87b-d48d109e772e-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:40 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Deleted volume successfully. Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6494a67c-01b3-487a-ad4c-78e9b2b90191 tempest-VolumesActionsTest-189651463 None] Lock "cinder-fb5ec66e-3953-4554-9347-be62dfaebefe-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (877e49bb-2c6c-4d67-9c82-dc2e0e067fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc6708a-8add-47f2-8232-abf43b4cdc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc6708a-8add-47f2-8232-abf43b4cdc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-421845902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cd3cdc-168c-409c-9242-957c541d8806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:41Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ec8a01-eded-41eb-9721-70c7498f59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ec8a01-eded-41eb-9721-70c7498f59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c19c17e-d128-4eb3-995c-593b98cf28e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c19c17e-d128-4eb3-995c-593b98cf28e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cd3cdc-168c-409c-9242-957c541d8806', 'volume_name': 'volume-c6cd3cdc-168c-409c-9242-957c541d8806', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35b9e35-2bfd-4ba1-8a66-aee85ce87492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35b9e35-2bfd-4ba1-8a66-aee85ce87492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30822709-923e-449f-adfc-143d196ff5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Volume c6cd3cdc-168c-409c-9242-957c541d8806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cd3cdc-168c-409c-9242-957c541d8806', 'volume_size': 1} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-421845902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cd3cdc-168c-409c-9242-957c541d8806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:41Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Creating volume c6cd3cdc-168c-409c-9242-957c541d8806 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:40 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:40 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 1073741824 Nov 04 22:32:40 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:41 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 1073741824" returned: 0 in 0.531s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:41 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 Nov 04 22:32:41 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:41 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806" returned: 0 in 0.505s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30822709-923e-449f-adfc-143d196ff5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cd3cdc-168c-409c-9242-957c541d8806', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c110aad6-4085-438b-8712-9934336865d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:41 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Volume volume-c6cd3cdc-168c-409c-9242-957c541d8806 (c6cd3cdc-168c-409c-9242-957c541d8806): created successfully Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c110aad6-4085-438b-8712-9934336865d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (877e49bb-2c6c-4d67-9c82-dc2e0e067fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e6a68c2a-0c0d-4277-946e-0f47a14ab2a5 tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-c6cd3cdc-168c-409c-9242-957c541d8806-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "cinder-c6cd3cdc-168c-409c-9242-957c541d8806-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-quobyte-c6cd3cdc-168c-409c-9242-957c541d8806" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-c6cd3cdc-168c-409c-9242-957c541d8806" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf3b1c5-3b09-4ce1-928e-bcfdb63a238e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:43 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 Nov 04 22:32:43 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:43 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:43 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806 Nov 04 22:32:43 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:43 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c6cd3cdc-168c-409c-9242-957c541d8806" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-c6cd3cdc-168c-409c-9242-957c541d8806" released by "delete_volume" :: held 0.698s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Created reservations ['c13af027-06f9-4ca1-8dd5-8819eabf8ae5', 'ab517f5c-babc-4543-8d2f-715d8d5e7543', '31b1e3c9-b579-4ca3-9ac3-2a9b0dbe86f6', '3a669a1b-a1c1-44be-8183-d013853db885'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:43 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:43 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:43 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:43 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Deleted volume successfully. Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e0dce6a5-e0f6-4145-bfe5-fb2f823ad0b6 tempest-VolumesActionsTest-189651463 None] Lock "cinder-c6cd3cdc-168c-409c-9242-957c541d8806-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "cinder-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Acquiring lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b244c88c-4708-475b-bcbc-52ab9ce957e3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (9ac754be-2905-45a8-b4a3-227478c23315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219e9019-204c-418e-9dc5-72ecf6fa4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219e9019-204c-418e-9dc5-72ecf6fa4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911445468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2fd64a-08e4-4120-ab4c-ac05bcb7f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:44Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c1190e-c51e-4082-aa2f-cea2b2729970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c1190e-c51e-4082-aa2f-cea2b2729970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc29deb-6e95-4c28-8d56-5d1b4bfefc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc29deb-6e95-4c28-8d56-5d1b4bfefc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2fd64a-08e4-4120-ab4c-ac05bcb7f222', 'volume_name': 'volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a6a48f-2e5f-4dbb-9516-619b3985e84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a6a48f-2e5f-4dbb-9516-619b3985e84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:44 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:32:44 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf492b-564f-4389-98d0-5d8bf58b012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Volume 7d2fd64a-08e4-4120-ab4c-ac05bcb7f222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222', 'volume_size': 1} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911445468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2fd64a-08e4-4120-ab4c-ac05bcb7f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:44Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Creating volume 7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:44 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:44 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 1073741824 Nov 04 22:32:44 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:44 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:44 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99 Nov 04 22:32:44 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:45 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 1073741824" returned: 0 in 0.425s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:45 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 Nov 04 22:32:45 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:45 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "cinder-quobyte-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99" released by "delete_volume" :: held 0.720s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Created reservations ['daee5f8c-4f39-4113-8dc3-092405a53016', 'bfb50ae7-99da-4b41-823e-afde5e5b5179', 'd1c2c77c-4810-47fe-b10f-f2ea5cf4b479', 'e78d9687-d2f3-4687-99b4-710d0af0282b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:45 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:45 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:45 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" returned: 0 in 0.253s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf492b-564f-4389-98d0-5d8bf58b012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708e39c-5653-4c33-8875-3a74ce9ec62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Volume volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 (7d2fd64a-08e4-4120-ab4c-ac05bcb7f222): created successfully Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708e39c-5653-4c33-8875-3a74ce9ec62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (9ac754be-2905-45a8-b4a3-227478c23315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4882204b-e783-4e96-85ff-a72228eb4f4f tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:45 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Deleted volume successfully. Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deed6e96-a2cf-4800-83f7-14ed35906568 tempest-TestStampPattern-698249012 None] Lock "cinder-e06a8af6-6234-4f4d-bfbb-3c6bacd97e99-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "cinder-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-quobyte-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c4404-a510-49ba-9ce3-b59f089f9edd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:45 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 Nov 04 22:32:45 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:46 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" returned: 0 in 0.396s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:46 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222 Nov 04 22:32:46 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:46 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" returned: 0 in 0.304s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222" released by "delete_volume" :: held 0.770s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Created reservations ['dba1337c-1f05-42f1-aba0-52c82a900748', 'f605ea03-cfae-44a7-8ad5-cc2bc302ed93', 'a5097ba1-048b-4c38-b5c6-3731357b424e', 'da46cf3d-2890-47d6-b87f-2408bb22048a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:46 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:46 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:47 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.444s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Deleted volume successfully. Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8482b840-9624-4b41-b507-e5889c429915 tempest-VolumesActionsTest-189651463 None] Lock "cinder-7d2fd64a-08e4-4120-ab4c-ac05bcb7f222-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (045b8775-8fb8-4e91-93d0-ee0c91eb969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ef6347-92a4-4dd8-808b-fb5e892dd2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ef6347-92a4-4dd8-808b-fb5e892dd2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445691768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:48Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9163c1df-ed9b-4a9f-8f52-850f4931450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9163c1df-ed9b-4a9f-8f52-850f4931450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c6bd6f-3c20-4a4a-bf62-a5398486ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c6bd6f-3c20-4a4a-bf62-a5398486ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8', 'volume_name': 'volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b70fba-7764-4ad2-b820-7f258c1a72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b70fba-7764-4ad2-b820-7f258c1a72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53afd62-429f-403b-826d-16fc4d89752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Volume 7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8', 'volume_size': 1} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445691768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:48Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Creating volume 7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:47 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:47 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 1073741824 Nov 04 22:32:47 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:48 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 1073741824" returned: 0 in 0.519s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:48 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 Nov 04 22:32:48 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:48 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53afd62-429f-403b-826d-16fc4d89752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ca7abb-7745-421b-98f4-cb55b5dab7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Volume volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 (7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8): created successfully Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ca7abb-7745-421b-98f4-cb55b5dab7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (045b8775-8fb8-4e91-93d0-ee0c91eb969d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b07a8eea-86db-404c-a170-3a0022e51ff5 tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "cinder-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Acquiring lock "cinder-quobyte-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a527e-95ad-434b-962f-5262c45064cb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:50 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 Nov 04 22:32:50 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:50 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:50 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8 Nov 04 22:32:50 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:50 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "cinder-quobyte-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8" released by "delete_volume" :: held 0.885s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:50 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Created reservations ['653cc680-23d3-4754-85bd-a61550f8d54c', 'f4f8a3e0-0c40-45d0-a5ba-36f4595a3e9c', 'ba14a74e-46a9-4e0e-ad14-3b81d2d44d24', 'd887a560-1f10-4e6b-b209-b216695d0db2'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:51 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:51 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:51 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Deleted volume successfully. Nov 04 22:32:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd219ed-254c-408d-9e3e-b063df120718 tempest-VolumesActionsTest-189651463 None] Lock "cinder-7c6b9b3b-4f5a-4e64-b365-ff2ab5dacfe8-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-ba5d238e-0ae9-4b31-bd26-940b9693d59e req-8d5839cd-7389-496c-b2de-c1c6d62bf66e tempest-TestMinimumBasicScenario-658085755 None] Terminate volume connection completed successfully. Nov 04 22:32:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-ba5d238e-0ae9-4b31-bd26-940b9693d59e req-8d5839cd-7389-496c-b2de-c1c6d62bf66e tempest-TestMinimumBasicScenario-658085755 None] Deleting attachment 26d961df-8aeb-4379-9c17-f518fda51260. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:32:52 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (51346cac-0a3b-42af-81e4-419b008ddf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a450c6-5b71-4320-9690-d34f25c99a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a450c6-5b71-4320-9690-d34f25c99a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127910516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:53Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a236ba-9ab7-4617-a7d5-ae3ed20eede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a236ba-9ab7-4617-a7d5-ae3ed20eede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac46aa0c-f0b0-4d58-9d5e-75a2bd10754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac46aa0c-f0b0-4d58-9d5e-75a2bd10754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805', 'volume_name': 'volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c50382-6586-49a5-8f43-86ca53d9c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c50382-6586-49a5-8f43-86ca53d9c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8ffcc2-bcb1-4532-bc42-eaa2471d1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:53 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Volume c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805', 'volume_size': 1} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127910516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6985e0057b4487bcec701fe38195fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:32:53Z,use_quota=True,user_id='d5cc01a2e89c44aa8909bafc1071d0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Creating volume c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:32:53 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:53 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 1073741824 Nov 04 22:32:53 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "cinder-85d6d022-2765-4fa2-9c92-6424186ae423-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "cinder-85d6d022-2765-4fa2-9c92-6424186ae423-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:53 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 1073741824" returned: 0 in 0.594s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "cinder-quobyte-85d6d022-2765-4fa2-9c92-6424186ae423" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "cinder-quobyte-85d6d022-2765-4fa2-9c92-6424186ae423" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e25cc0-a9bb-4c72-96d6-fd0ebed2d77e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:53 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 Nov 04 22:32:53 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:53 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 Nov 04 22:32:53 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:54 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8ffcc2-bcb1-4532-bc42-eaa2471d1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c910edb4-b07f-4bab-b5c2-7c32ec1e4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:32:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Volume volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 (c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805): created successfully Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c910edb4-b07f-4bab-b5c2-7c32ec1e4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Flow 'volume_create_manager' (51346cac-0a3b-42af-81e4-419b008ddf20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:32:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-274cdbf2-2a2c-4f25-b08a-7a2826a4ee78 tempest-VolumesActionsTest-2039996811 None] Created volume successfully. Nov 04 22:32:54 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423" returned: 0 in 0.506s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:54 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423 Nov 04 22:32:54 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:54 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-85d6d022-2765-4fa2-9c92-6424186ae423" returned: 0 in 0.263s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "cinder-quobyte-85d6d022-2765-4fa2-9c92-6424186ae423" released by "delete_volume" :: held 0.848s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Created reservations ['ed053726-d955-42c1-ac58-5825440ddc6a', 'ba550093-fbbc-4373-9a8d-3c17de1430db', '05efa99f-1f45-4483-b3d7-a36e4a1adcc1', 'f2559dbc-ac51-4f35-9d0a-306872bc6315'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:54 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:54 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:55 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Deleted volume successfully. Nov 04 22:32:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-deef1744-d2b3-4aa9-aca8-70719e07ba26 tempest-TestMinimumBasicScenario-658085755 None] Lock "cinder-85d6d022-2765-4fa2-9c92-6424186ae423-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "cinder-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Acquiring lock "cinder-quobyte-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "cinder-quobyte-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb50dba-77fd-4cdd-955d-50065990b0ab]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:56 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 Nov 04 22:32:56 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:56 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" returned: 0 in 0.516s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:56 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:56 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:56 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805 Nov 04 22:32:56 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:56 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.354s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:32:57 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" returned: 0 in 0.351s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "cinder-quobyte-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805" released by "delete_volume" :: held 0.979s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Created reservations ['959e3021-b240-4a7f-9415-61c57163d957', '73be535d-ce62-40a0-a716-dc06df89c491', '0cb010db-d49c-40b9-aeb4-1f78662966b5', 'bc393612-9586-4988-ba26-46966f413be0'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:32:57 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:32:57 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:32:57 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:32:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Deleted volume successfully. Nov 04 22:32:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2b54473-dc0f-4c36-85fa-d8eb826809ce tempest-VolumesActionsTest-2039996811 None] Lock "cinder-c5a89c0e-fa8e-4ec4-ad5b-42a64b7b1805-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Flow 'volume_create_manager' (6ed6a478-af58-45ba-b1a0-cbfd9adbad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fe4942-c58e-4da2-9f2e-55e303fbd317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fe4942-c58e-4da2-9f2e-55e303fbd317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d68162-0a82-4120-bc39-205bf37aafdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a06a4c83e8478db9846e43fa0bec93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:07Z,use_quota=True,user_id='e8a496447860467abb15f1c14bad3dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac4bfc47-042d-45f7-924c-11ac050f2493),volume_type_id=ac4bfc47-042d-45f7-924c-11ac050f2493)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c66cf6c-7b05-4169-92f8-a0588e54f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c66cf6c-7b05-4169-92f8-a0588e54f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cec9bbf-ab16-4f25-9700-c21885bc5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cec9bbf-ab16-4f25-9700-c21885bc5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5d68162-0a82-4120-bc39-205bf37aafdc', 'volume_name': 'volume-f5d68162-0a82-4120-bc39-205bf37aafdc', 'volume_size': 1, 'image_id': '64431c66-7296-4d58-8558-28c178fd70c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35afd1bed259ca960695813698371d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49a06a4c83e8478db9846e43fa0bec93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dacfde4a298ea89cea4bf483521773ca4aa937dc6f42032c7482e60ca64435056a4c2db3f21f7ac4b53f99c4f0094ae2b75bb0f006e5224462ac9046ff21d935', 'id': '64431c66-7296-4d58-8558-28c178fd70c1', 'created_at': datetime.datetime(2026, 11, 4, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64431c66-7296-4d58-8558-28c178fd70c1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630324c6-12f4-44a4-94c3-4ea56ac4a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630324c6-12f4-44a4-94c3-4ea56ac4a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f065ae6c-b054-49e4-860a-b59e862b0077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Volume f5d68162-0a82-4120-bc39-205bf37aafdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5d68162-0a82-4120-bc39-205bf37aafdc', 'volume_size': 1, 'image_id': '64431c66-7296-4d58-8558-28c178fd70c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35afd1bed259ca960695813698371d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49a06a4c83e8478db9846e43fa0bec93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dacfde4a298ea89cea4bf483521773ca4aa937dc6f42032c7482e60ca64435056a4c2db3f21f7ac4b53f99c4f0094ae2b75bb0f006e5224462ac9046ff21d935', 'id': '64431c66-7296-4d58-8558-28c178fd70c1', 'created_at': datetime.datetime(2026, 11, 4, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64431c66-7296-4d58-8558-28c178fd70c1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 22:33:06 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Trying to clone f5d68162-0a82-4120-bc39-205bf37aafdc from image 64431c66-7296-4d58-8558-28c178fd70c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:33:07 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:33:07 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Image download 0.00 MB at 0.00 MB/s Nov 04 22:33:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5914c3b4-c0ba-4258-a3a0-c410c03d33a6]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:07 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:07 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:07 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:07 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:07 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:08 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Temporary image 64431c66-7296-4d58-8558-28c178fd70c1 is fetched for user e8a496447860467abb15f1c14bad3dc2. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[46385a8f-28c6-4e5d-82d0-c3dbc95d40cb]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:08 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:08 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:08 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:08 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:08 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:08 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d68162-0a82-4120-bc39-205bf37aafdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a06a4c83e8478db9846e43fa0bec93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:07Z,use_quota=True,user_id='e8a496447860467abb15f1c14bad3dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac4bfc47-042d-45f7-924c-11ac050f2493),volume_type_id=ac4bfc47-042d-45f7-924c-11ac050f2493)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Creating volume f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:08 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:08 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1073741824 Nov 04 22:33:08 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:09 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1073741824" returned: 0 in 0.532s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:09 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc Nov 04 22:33:09 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:09 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Attempting download of 64431c66-7296-4d58-8558-28c178fd70c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}])) to volume f5d68162-0a82-4120-bc39-205bf37aafdc. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704587c-3b5b-4e53-8841-062d909f12c4]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:10 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri Nov 04 22:33:10 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:10 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri" returned: 0 in 0.385s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:10 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri Nov 04 22:33:10 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:10 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri" returned: 1 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64431c66-7296-4d58-8558-28c178fd70c1_fne9d0ri' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd751a-5751-41c6-8439-baa1b97d3160]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:10 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:10 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:11 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:11 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD Nov 04 22:33:11 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:11 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] 64431c66-7296-4d58-8558-28c178fd70c1 was raw, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:11 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc Nov 04 22:33:11 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:11 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc" returned: 0 in 0.561s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64431c66-7296-4d58-8558-28c178fd70c1_b4tba4mbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:33:11 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 22:33:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:11 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1G Nov 04 22:33:11 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:12 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc 1G" returned: 0 in 0.337s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Downloaded image 64431c66-7296-4d58-8558-28c178fd70c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}])) to volume f5d68162-0a82-4120-bc39-205bf37aafdc successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Temporary image 64431c66-7296-4d58-8558-28c178fd70c1 for user e8a496447860467abb15f1c14bad3dc2 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Marking volume f5d68162-0a82-4120-bc39-205bf37aafdc as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Copying metadata from image 64431c66-7296-4d58-8558-28c178fd70c1 to f5d68162-0a82-4120-bc39-205bf37aafdc. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Creating volume glance metadata for volume f5d68162-0a82-4120-bc39-205bf37aafdc backed by image 64431c66-7296-4d58-8558-28c178fd70c1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '64431c66-7296-4d58-8558-28c178fd70c1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '35afd1bed259ca960695813698371d0b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f065ae6c-b054-49e4-860a-b59e862b0077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d68162-0a82-4120-bc39-205bf37aafdc', 'volume_size': 1, 'image_id': '64431c66-7296-4d58-8558-28c178fd70c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64431c66-7296-4d58-8558-28c178fd70c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35afd1bed259ca960695813698371d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49a06a4c83e8478db9846e43fa0bec93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dacfde4a298ea89cea4bf483521773ca4aa937dc6f42032c7482e60ca64435056a4c2db3f21f7ac4b53f99c4f0094ae2b75bb0f006e5224462ac9046ff21d935', 'id': '64431c66-7296-4d58-8558-28c178fd70c1', 'created_at': datetime.datetime(2026, 11, 4, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64431c66-7296-4d58-8558-28c178fd70c1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a5188a-f87e-4a37-8784-f5296692c543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Volume volume-f5d68162-0a82-4120-bc39-205bf37aafdc (f5d68162-0a82-4120-bc39-205bf37aafdc): created successfully Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a5188a-f87e-4a37-8784-f5296692c543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Flow 'volume_create_manager' (6ed6a478-af58-45ba-b1a0-cbfd9adbad80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9acb8dca-833f-4fa8-b43a-6485d3151f5b tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Created volume successfully. Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Acquiring lock "cinder-f5d68162-0a82-4120-bc39-205bf37aafdc-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "cinder-f5d68162-0a82-4120-bc39-205bf37aafdc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Acquiring lock "cinder-quobyte-f5d68162-0a82-4120-bc39-205bf37aafdc" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "cinder-quobyte-f5d68162-0a82-4120-bc39-205bf37aafdc" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ba11f-09a0-4e9a-9640-773da357f589]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:13 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc Nov 04 22:33:13 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:13 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc" returned: 0 in 0.454s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:13 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc Nov 04 22:33:13 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (376980a2-afb7-422e-930c-07a3d36fa8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150f6fac-dfe0-4b43-a592-95d75bad085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150f6fac-dfe0-4b43-a592-95d75bad085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2074858557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f1eec0-b307-42b6-aee5-31f27a1d3f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:14Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf389ac9-60fa-48bd-b34f-ea86b4f2dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf389ac9-60fa-48bd-b34f-ea86b4f2dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbf9be7-731c-4da2-a534-4067c3b76d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbf9be7-731c-4da2-a534-4067c3b76d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f1eec0-b307-42b6-aee5-31f27a1d3f72', 'volume_name': 'volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0adb3c-b568-40b7-8138-e9e213bda7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0adb3c-b568-40b7-8138-e9e213bda7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07a30e7-7b9d-4975-aa79-e95e7adde70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:13 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Volume b2f1eec0-b307-42b6-aee5-31f27a1d3f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72', 'volume_size': 1} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2074858557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f1eec0-b307-42b6-aee5-31f27a1d3f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:14Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Creating volume b2f1eec0-b307-42b6-aee5-31f27a1d3f72 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:13 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:13 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 1073741824 Nov 04 22:33:13 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:13 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f5d68162-0a82-4120-bc39-205bf37aafdc" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "cinder-quobyte-f5d68162-0a82-4120-bc39-205bf37aafdc" released by "delete_volume" :: held 0.797s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:13 devstack cinder-volume[87173]: WARNING cinder.quota [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:33:13 devstack cinder-volume[87173]: WARNING cinder.quota [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 22:33:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Created reservations ['7a62c2e2-a4de-44ab-a0bc-e177b49ddafd', 'f63551e2-5c72-4c31-b172-a6eb6322aad5', '9038a896-902a-4b85-a20a-c124d7f8bcf9', 'b40fcc52-623a-4fb0-8dcb-61e4356f2e42'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:14 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:14 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:14 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 1073741824" returned: 0 in 0.538s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:14 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Deleted volume successfully. Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0dd0c538-473c-4675-bc05-7f9e4a31d3dc tempest-VolumeAndVolumeTypeFromImageTest-1841000603 None] Lock "cinder-f5d68162-0a82-4120-bc39-205bf37aafdc-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:14 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 Nov 04 22:33:14 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:14 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07a30e7-7b9d-4975-aa79-e95e7adde70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3908105e-1f04-4d7e-9cd9-b871b2d64dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Volume volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 (b2f1eec0-b307-42b6-aee5-31f27a1d3f72): created successfully Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3908105e-1f04-4d7e-9cd9-b871b2d64dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (376980a2-afb7-422e-930c-07a3d36fa8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2f0a185d-53d2-44e7-a170-e2ad786b1d15 tempest-VolumesListAdminTestJSON-1426626569 None] Created volume successfully. Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (bec84b65-0d67-47d4-b413-f4be166ce4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb88cc4-19c8-4565-90db-51c87d88e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb88cc4-19c8-4565-90db-51c87d88e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-661955016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab87ccde-0308-485f-9a41-d97fe5bb107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:16Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5118c54c-555f-4d60-a841-44a7b70ebdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5118c54c-555f-4d60-a841-44a7b70ebdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f178e95-ffe8-46e3-990b-b255f6f0671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f178e95-ffe8-46e3-990b-b255f6f0671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab87ccde-0308-485f-9a41-d97fe5bb107d', 'volume_name': 'volume-ab87ccde-0308-485f-9a41-d97fe5bb107d', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d5eba0-272d-430d-8bde-789820646eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d5eba0-272d-430d-8bde-789820646eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0e00a-b58c-4c4a-85be-708b3e64dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Volume ab87ccde-0308-485f-9a41-d97fe5bb107d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab87ccde-0308-485f-9a41-d97fe5bb107d', 'volume_size': 1} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-661955016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab87ccde-0308-485f-9a41-d97fe5bb107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:16Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Creating volume ab87ccde-0308-485f-9a41-d97fe5bb107d {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:16 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:16 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d 1073741824 Nov 04 22:33:16 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:16 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d 1073741824" returned: 0 in 0.497s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:17 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d Nov 04 22:33:17 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:17 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0e00a-b58c-4c4a-85be-708b3e64dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab87ccde-0308-485f-9a41-d97fe5bb107d', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d5139c-b960-47e6-becb-e278e6bb74ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:17 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Volume volume-ab87ccde-0308-485f-9a41-d97fe5bb107d (ab87ccde-0308-485f-9a41-d97fe5bb107d): created successfully Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d5139c-b960-47e6-becb-e278e6bb74ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (bec84b65-0d67-47d4-b413-f4be166ce4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-59a01c05-e851-429e-91a4-6846297a0ed9 tempest-VolumesListAdminTestJSON-1426626569 None] Created volume successfully. Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (088a04d3-d3dc-4697-bda1-dd1dae04dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637e56c0-1090-4a8d-9559-fb6dfb4ba56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637e56c0-1090-4a8d-9559-fb6dfb4ba56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045673866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3258296a-51e1-47db-86a0-1e00cc42081a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:19Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75abcab-eca9-4b83-83af-e9ae15366d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75abcab-eca9-4b83-83af-e9ae15366d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e60b405-bee6-4ec8-b9c5-fd4f05b1b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e60b405-bee6-4ec8-b9c5-fd4f05b1b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3258296a-51e1-47db-86a0-1e00cc42081a', 'volume_name': 'volume-3258296a-51e1-47db-86a0-1e00cc42081a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1add9b8a-1e04-42ea-8156-09dd3c3f258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1add9b8a-1e04-42ea-8156-09dd3c3f258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b98ea67-6a7e-42eb-912d-e78fe83613bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:19 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Volume 3258296a-51e1-47db-86a0-1e00cc42081a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3258296a-51e1-47db-86a0-1e00cc42081a', 'volume_size': 1} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045673866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3258296a-51e1-47db-86a0-1e00cc42081a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be65f7d8e51e4f75a77f446919735f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:19Z,use_quota=True,user_id='189666ae517646aa96f0d58b20a1e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Creating volume 3258296a-51e1-47db-86a0-1e00cc42081a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:19 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:19 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a 1073741824 Nov 04 22:33:19 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:19 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a 1073741824" returned: 0 in 0.577s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:20 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a Nov 04 22:33:20 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:20 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a" returned: 0 in 0.316s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b98ea67-6a7e-42eb-912d-e78fe83613bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3258296a-51e1-47db-86a0-1e00cc42081a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3352b0-115e-4e92-976d-a221f6bc4ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:20 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Volume volume-3258296a-51e1-47db-86a0-1e00cc42081a (3258296a-51e1-47db-86a0-1e00cc42081a): created successfully Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3352b0-115e-4e92-976d-a221f6bc4ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Flow 'volume_create_manager' (088a04d3-d3dc-4697-bda1-dd1dae04dec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-30a0e9ba-6a31-418a-9a86-0b040cc9b2e3 tempest-VolumesListAdminTestJSON-1426626569 None] Created volume successfully. Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=114,cinder:SELECT=100,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=96,cinder:INSERT=34,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Flow 'volume_create_manager' (a31b75dd-d493-4d15-a89a-e69e3b77b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad966c60-7499-4da2-9b57-0aa4225eff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad966c60-7499-4da2-9b57-0aa4225eff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f73310-acab-486a-8d26-8f94c07214c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e97c38ccee8499cb1c8bdd69df9b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:23Z,use_quota=True,user_id='e120ed0d03f04c4593d846c904fb3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaf6e3-001c-44c8-b439-0b9d70f8bfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaf6e3-001c-44c8-b439-0b9d70f8bfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b779e7a-f849-4ddf-b878-e6561af34b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b779e7a-f849-4ddf-b878-e6561af34b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f73310-acab-486a-8d26-8f94c07214c6', 'volume_name': 'volume-81f73310-acab-486a-8d26-8f94c07214c6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d723a5f-1d66-4d28-9c95-0c6414080461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d723a5f-1d66-4d28-9c95-0c6414080461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f092ad38-d9fa-483f-bdbb-25e114481e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Volume 81f73310-acab-486a-8d26-8f94c07214c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f73310-acab-486a-8d26-8f94c07214c6', 'volume_size': 1} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f73310-acab-486a-8d26-8f94c07214c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e97c38ccee8499cb1c8bdd69df9b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:23Z,use_quota=True,user_id='e120ed0d03f04c4593d846c904fb3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Creating volume 81f73310-acab-486a-8d26-8f94c07214c6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:22 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:22 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 1073741824 Nov 04 22:33:22 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:23 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 1073741824" returned: 0 in 0.551s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:23 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 Nov 04 22:33:23 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:23 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6" returned: 0 in 0.271s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f092ad38-d9fa-483f-bdbb-25e114481e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f73310-acab-486a-8d26-8f94c07214c6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb711989-dc7a-45cf-ac7c-4a041d9faf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:23 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Volume volume-81f73310-acab-486a-8d26-8f94c07214c6 (81f73310-acab-486a-8d26-8f94c07214c6): created successfully Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb711989-dc7a-45cf-ac7c-4a041d9faf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:23 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Flow 'volume_create_manager' (a31b75dd-d493-4d15-a89a-e69e3b77b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-89dfc228-cd23-49d7-9dd2-119c0eecfd5e tempest-VolumesListAdminTestJSON-415247049 None] Created volume successfully. Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Acquiring lock "cinder-81f73310-acab-486a-8d26-8f94c07214c6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "cinder-81f73310-acab-486a-8d26-8f94c07214c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Acquiring lock "cinder-quobyte-81f73310-acab-486a-8d26-8f94c07214c6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "cinder-quobyte-81f73310-acab-486a-8d26-8f94c07214c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d50eb2d-65e8-4227-9dd2-3f1fa8dc8cd9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-3258296a-51e1-47db-86a0-1e00cc42081a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-3258296a-51e1-47db-86a0-1e00cc42081a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-quobyte-3258296a-51e1-47db-86a0-1e00cc42081a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-3258296a-51e1-47db-86a0-1e00cc42081a" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:25 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 Nov 04 22:33:25 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e072c4b9-81ac-48b4-bea8-842f7654b08d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:25 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a Nov 04 22:33:25 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:25 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6" returned: 0 in 0.491s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:25 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6 Nov 04 22:33:25 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:25 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a" returned: 0 in 0.562s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:25 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a Nov 04 22:33:25 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:25 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-81f73310-acab-486a-8d26-8f94c07214c6" returned: 0 in 0.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "cinder-quobyte-81f73310-acab-486a-8d26-8f94c07214c6" released by "delete_volume" :: held 1.007s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Created reservations ['ac4b3f58-4990-486d-9cce-6f81dc01582e', 'bb9bf4f3-f108-4e89-93f4-7c78e6a4d580', 'f15d528a-f3e7-412e-880a-e3bd69a311f7', '7019bb30-9bcf-4ec1-9368-4a3ba150d351'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:33:26 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3258296a-51e1-47db-86a0-1e00cc42081a" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-3258296a-51e1-47db-86a0-1e00cc42081a" released by "delete_volume" :: held 1.027s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:26 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:26 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Created reservations ['17d5c8d7-52e3-46f9-87ff-d2b7e54702b7', '52ac4895-d430-4601-af44-c8a37d89a6cd', '94accefd-04e8-4313-b940-51cc75236aab', '06c8bf8e-5f65-4f2d-a94d-891b909eaf52'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:26 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:26 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:26 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Deleted volume successfully. Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c1b351a4-f9fe-4423-a4e9-235124e0180b tempest-VolumesListAdminTestJSON-415247049 None] Lock "cinder-81f73310-acab-486a-8d26-8f94c07214c6-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:26 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.333s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Deleted volume successfully. Nov 04 22:33:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3a59829a-2ce7-4640-bd09-73bfe1b7abf5 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-3258296a-51e1-47db-86a0-1e00cc42081a-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-ab87ccde-0308-485f-9a41-d97fe5bb107d-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-ab87ccde-0308-485f-9a41-d97fe5bb107d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-quobyte-ab87ccde-0308-485f-9a41-d97fe5bb107d" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-ab87ccde-0308-485f-9a41-d97fe5bb107d" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[11380ffb-e909-4a23-917b-3772fe3ed736]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:27 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d Nov 04 22:33:27 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:27 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d" returned: 0 in 0.393s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:28 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d Nov 04 22:33:28 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:28 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ab87ccde-0308-485f-9a41-d97fe5bb107d" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-ab87ccde-0308-485f-9a41-d97fe5bb107d" released by "delete_volume" :: held 0.735s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Created reservations ['7fd8e550-38ac-43af-bda3-95929fec812c', '00f6aac7-119d-4e7f-9cbd-f1394f7045fe', '3d7e79f6-9256-4c6f-b8ec-273fb926348d', '6873b23f-1f5a-46a0-9f44-22f3359201bb'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:28 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:28 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-b2f1eec0-b307-42b6-aee5-31f27a1d3f72-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-b2f1eec0-b307-42b6-aee5-31f27a1d3f72-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "cinder-quobyte-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:28 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Deleted volume successfully. Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd4177-ef99-4e91-8982-36e2fa4e6f8a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fa132986-2a18-4229-8af1-5204b3aa9f99 tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-ab87ccde-0308-485f-9a41-d97fe5bb107d-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:29 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 Nov 04 22:33:29 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:29 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" returned: 0 in 0.529s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:29 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72 Nov 04 22:33:29 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:29 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" returned: 0 in 0.300s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-quobyte-b2f1eec0-b307-42b6-aee5-31f27a1d3f72" released by "delete_volume" :: held 0.905s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Created reservations ['8f337ce0-4b43-4c95-befa-d5a38e7094e7', 'c6a14c3b-19f3-4ca2-9f35-9ef8e27efc4a', '3c54ddee-e59e-4d2a-91a8-33d16b608ef0', 'b12e822e-86d3-4716-88a4-b77fbb63fdd1'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:29 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:29 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:30 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.386s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:30 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Deleted volume successfully. Nov 04 22:33:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e047925-6084-425d-8385-89f1b3b7286b tempest-VolumesListAdminTestJSON-1426626569 None] Lock "cinder-b2f1eec0-b307-42b6-aee5-31f27a1d3f72-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:33:39 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=25,cinder:UPDATE=34,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:33:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=18,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Flow 'volume_create_manager' (6c10a9ee-adc2-4bb7-a15c-b3ea79631fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e815c9c2-a876-4846-8726-397f3398d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e815c9c2-a876-4846-8726-397f3398d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1737185694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517da8a-23a1-4584-8dd3-6de02a5b0549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1a5ceb8614f96bcf3f6e0dd445863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:47Z,use_quota=True,user_id='2694f47ce7ff4704b8bc3ac036fe6b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fefaa4f-32ca-4de3-9105-1eba5f36b430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fefaa4f-32ca-4de3-9105-1eba5f36b430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fe40a3-0577-42d6-83b1-1cb056b53e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fe40a3-0577-42d6-83b1-1cb056b53e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6517da8a-23a1-4584-8dd3-6de02a5b0549', 'volume_name': 'volume-6517da8a-23a1-4584-8dd3-6de02a5b0549', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8519ca7e-3d6b-4c7a-bdde-9fee86bd3475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8519ca7e-3d6b-4c7a-bdde-9fee86bd3475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df451704-effd-4c89-817f-88be1a8e75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Volume 6517da8a-23a1-4584-8dd3-6de02a5b0549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6517da8a-23a1-4584-8dd3-6de02a5b0549', 'volume_size': 1} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1737185694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517da8a-23a1-4584-8dd3-6de02a5b0549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1a5ceb8614f96bcf3f6e0dd445863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:47Z,use_quota=True,user_id='2694f47ce7ff4704b8bc3ac036fe6b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Creating volume 6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:46 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:33:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:46 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 1073741824 Nov 04 22:33:46 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:47 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 1073741824" returned: 0 in 0.587s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:47 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:33:47 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:47 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df451704-effd-4c89-817f-88be1a8e75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6517da8a-23a1-4584-8dd3-6de02a5b0549', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdc27c-7d76-43a9-9237-8391db88d5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Volume volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 (6517da8a-23a1-4584-8dd3-6de02a5b0549): created successfully Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdc27c-7d76-43a9-9237-8391db88d5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Flow 'volume_create_manager' (6c10a9ee-adc2-4bb7-a15c-b3ea79631fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6d4aac84-e03c-4272-85f2-5797a603adaf tempest-SnapshotDependencyTests-892220306 None] Created volume successfully. Nov 04 22:33:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Creating offline snapshot 95017179-6091-4c2b-8f51-0b3a7981664f of volume 6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:33:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4644b66-3f35-4d74-bdbc-1c1bbd3252b3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:49 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:33:49 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:50 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.714s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:50 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f 1G Nov 04 22:33:50 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:51 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f 1G" returned: 0 in 0.863s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:51 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:33:51 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:51 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.630s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:51 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f is being set with open permissions: ugo+rw Nov 04 22:33:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:51 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:33:51 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:52 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.430s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:52 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info Nov 04 22:33:52 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:52 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:52 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info is being set with open permissions: ugo+rw Nov 04 22:33:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:52 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info Nov 04 22:33:52 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:53 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.info" returned: 0 in 0.473s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.757s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d615a591-f096-4e17-b1ab-273d66680079 tempest-SnapshotDependencyTests-892220306 None] Create snapshot completed successfully Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Flow 'volume_create_manager' (d782c698-c1d0-443e-8e7e-850fca7bd085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a96ba5-dda9-4e02-b865-36ace7c3515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a96ba5-dda9-4e02-b865-36ace7c3515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857ef9fd-ddb8-4d58-98f0-152b59e8432f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1a5ceb8614f96bcf3f6e0dd445863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95017179-6091-4c2b-8f51-0b3a7981664f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:33:55Z,use_quota=True,user_id='2694f47ce7ff4704b8bc3ac036fe6b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2a1347-aa7f-4c82-be61-3c5ca15e9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2a1347-aa7f-4c82-be61-3c5ca15e9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef1ea38-2950-49a8-a233-127afe04f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef1ea38-2950-49a8-a233-127afe04f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '857ef9fd-ddb8-4d58-98f0-152b59e8432f', 'volume_name': 'volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f', 'volume_size': 1, 'snapshot_id': '95017179-6091-4c2b-8f51-0b3a7981664f'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d8437-4177-48b8-a93c-7c67dfa09603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d8437-4177-48b8-a93c-7c67dfa09603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:33:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dbec63-a0db-490d-9b18-0bf694952495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:33:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Volume 857ef9fd-ddb8-4d58-98f0-152b59e8432f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f', 'volume_size': 1, 'snapshot_id': '95017179-6091-4c2b-8f51-0b3a7981664f'} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f-857ef9fd-ddb8-4d58-98f0-152b59e8432f" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f-857ef9fd-ddb8-4d58-98f0-152b59e8432f" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Creating volume 857ef9fd-ddb8-4d58-98f0-152b59e8432f from snapshot 95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] snapshot: 95017179-6091-4c2b-8f51-0b3a7981664f, volume: 857ef9fd-ddb8-4d58-98f0-152b59e8432f, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166832d-fef0-4691-88dc-4ac124b7cbe3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:55 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:33:55 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:55 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.623s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6517da8a-23a1-4584-8dd3-6de02a5b0549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea4f46-1e91-43de-83ea-12dd3e641a0c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:33:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:56 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:33:56 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:56 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.788s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:33:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:33:56 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:33:56 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:56 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f Nov 04 22:33:56 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:33:57 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Nov 04 22:33:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.626s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:33:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:33:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:33:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:33:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:34:04 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:34:05 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:34:05 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f" returned: 0 in 9.219s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:05 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:34:05 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Converted 1024.00 MB image at 111.06 MB/s Nov 04 22:34:05 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f is being set with open permissions: ugo+rw Nov 04 22:34:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:05 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f Nov 04 22:34:05 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:06 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" released by "_copy_volume_from_snapshot" :: held 11.087s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f-857ef9fd-ddb8-4d58-98f0-152b59e8432f" released by "_create_volume_from_snapshot" :: held 11.176s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.220s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dbec63-a0db-490d-9b18-0bf694952495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f', 'volume_size': 1, 'snapshot_id': '95017179-6091-4c2b-8f51-0b3a7981664f'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112777bb-c37b-469c-854b-d1f03126346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Volume volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f (857ef9fd-ddb8-4d58-98f0-152b59e8432f): created successfully Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112777bb-c37b-469c-854b-d1f03126346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Flow 'volume_create_manager' (d782c698-c1d0-443e-8e7e-850fca7bd085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-224e111e-78b7-464d-ba06-5660ce70ab9b tempest-SnapshotDependencyTests-892220306 None] Created volume successfully. Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-95017179-6091-4c2b-8f51-0b3a7981664f-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-95017179-6091-4c2b-8f51-0b3a7981664f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Deleting offline snapshot 95017179-6091-4c2b-8f51-0b3a7981664f of volume 6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] snapshot_file for this snap is: volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62bb6ff-3230-4372-ba03-e9b98bed0c5c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:07 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:34:07 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:07 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.540s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6517da8a-23a1-4584-8dd3-6de02a5b0549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253ce6f-25b9-4bef-9562-c50132e58f2c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:07 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:34:07 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:08 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.554s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:08 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:34:08 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:08 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:08 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f Nov 04 22:34:08 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:09 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549.95017179-6091-4c2b-8f51-0b3a7981664f" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-95017179-6091-4c2b-8f51-0b3a7981664f" released by "_delete_snapshot" :: held 1.838s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" released by "delete_snapshot" :: held 1.863s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Created reservations ['d15c2324-8fe6-4459-8ff2-c3e48dc94b06', 'ac4f53f8-e9f1-4edd-b038-f68b43321435', '717203a7-cd42-4731-bdad-aa675927281d', 'f1950ab9-1ba6-4a05-9247-488c7b026bb8'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Delete snapshot completed successfully. Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d51ca2fb-c635-4874-9f18-11cd50985419 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-95017179-6091-4c2b-8f51-0b3a7981664f-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-6517da8a-23a1-4584-8dd3-6de02a5b0549-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-6517da8a-23a1-4584-8dd3-6de02a5b0549-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237a2d8-d59d-42e0-b155-84077236c54e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:09 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:34:09 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:09 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.400s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:09 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549 Nov 04 22:34:09 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:10 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6517da8a-23a1-4584-8dd3-6de02a5b0549" returned: 0 in 0.281s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-6517da8a-23a1-4584-8dd3-6de02a5b0549" released by "delete_volume" :: held 0.754s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Created reservations ['9e26c275-5ee0-4bac-b4a8-39d9317ac701', 'e915ec71-b354-45a0-8413-203a66f991ad', '29438db2-eab5-4b3f-9f2e-169583a9ea96', '994ce3a8-d7ac-4167-a884-98f857e7b678'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:10 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:10 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-857ef9fd-ddb8-4d58-98f0-152b59e8432f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-857ef9fd-ddb8-4d58-98f0-152b59e8432f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:10 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Deleted volume successfully. Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fd0d85-9d5b-4463-a3f4-8f856825bc2f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42490005-e5f3-44e4-a011-00dbae66384e tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-6517da8a-23a1-4584-8dd3-6de02a5b0549-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:10 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f Nov 04 22:34:10 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:11 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f" returned: 0 in 0.400s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:11 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f Nov 04 22:34:11 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:11 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-857ef9fd-ddb8-4d58-98f0-152b59e8432f" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-quobyte-857ef9fd-ddb8-4d58-98f0-152b59e8432f" released by "delete_volume" :: held 0.729s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Created reservations ['ee964043-0d4f-448d-9b1f-1c4795c79f76', 'eca5435e-8102-4c5d-bbd9-009094bf6a83', 'f49caaad-192f-4b72-8dc5-72633a639276', '25e269da-cea8-47c5-9de5-a3bfbf04590b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:11 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:11 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:11 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.341s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Deleted volume successfully. Nov 04 22:34:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552c1f7b-cb66-485f-ab04-b8e91b77f786 tempest-SnapshotDependencyTests-892220306 None] Lock "cinder-857ef9fd-ddb8-4d58-98f0-152b59e8432f-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Flow 'volume_create_manager' (aa142989-4dbe-4027-8aa0-569773db615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e5f9d5-80e3-4800-8b66-5df5aed50188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e5f9d5-80e3-4800-8b66-5df5aed50188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-339151034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f244053-a8bf-46d7-a9aa-522b499a1f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bc0db33d6448a5846f4889b8562307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:18Z,use_quota=True,user_id='44498b06dab14b8cad3721996dec3538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be7ea37-bca1-4cf4-9b5f-6f389e94c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be7ea37-bca1-4cf4-9b5f-6f389e94c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36f897-f8f2-4143-a730-1cfcb2b2c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36f897-f8f2-4143-a730-1cfcb2b2c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f244053-a8bf-46d7-a9aa-522b499a1f37', 'volume_name': 'volume-8f244053-a8bf-46d7-a9aa-522b499a1f37', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034e8f64-4509-4297-bbeb-607de2daf802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034e8f64-4509-4297-bbeb-607de2daf802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fac56d3-62cd-45f3-91a0-e12a0f9f5de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:17 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Volume 8f244053-a8bf-46d7-a9aa-522b499a1f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f244053-a8bf-46d7-a9aa-522b499a1f37', 'volume_size': 1} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-339151034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f244053-a8bf-46d7-a9aa-522b499a1f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bc0db33d6448a5846f4889b8562307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:18Z,use_quota=True,user_id='44498b06dab14b8cad3721996dec3538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Creating volume 8f244053-a8bf-46d7-a9aa-522b499a1f37 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:17 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:17 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 1073741824 Nov 04 22:34:17 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:18 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 1073741824" returned: 0 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:18 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 Nov 04 22:34:18 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Flow 'volume_create_manager' (6f2ca5bf-d068-4d51-b693-9d0c3620b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e35d01b-5ab8-4e3c-85a9-b2f3f532c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:18 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37" returned: 0 in 0.311s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e35d01b-5ab8-4e3c-85a9-b2f3f532c915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988894179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c73c7ef-deaf-41ae-afb2-3a197751c657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afffb22d5772400d8a42ee2483dd6de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:19Z,use_quota=True,user_id='c770cf0f94ff4eecb7f37b4f3e48fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853c5d7a-2984-4482-a4ab-cb5c981666cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853c5d7a-2984-4482-a4ab-cb5c981666cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9f5dab-3a09-4c4a-ba81-3a34a6d58aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fac56d3-62cd-45f3-91a0-e12a0f9f5de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f244053-a8bf-46d7-a9aa-522b499a1f37', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ff3e0b-afb9-4c8f-ada9-fbad14572367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:18 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Volume volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 (8f244053-a8bf-46d7-a9aa-522b499a1f37): created successfully Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ff3e0b-afb9-4c8f-ada9-fbad14572367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Flow 'volume_create_manager' (aa142989-4dbe-4027-8aa0-569773db615f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ded7c9d5-5f85-4b4e-a406-7163740f8732 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Created volume successfully. Nov 04 22:34:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9f5dab-3a09-4c4a-ba81-3a34a6d58aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c73c7ef-deaf-41ae-afb2-3a197751c657', 'volume_name': 'volume-9c73c7ef-deaf-41ae-afb2-3a197751c657', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1941d7c1-fe71-4590-b97c-4729c68ebe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1941d7c1-fe71-4590-b97c-4729c68ebe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6103c9c4-347c-4aa1-aae7-cc1a0ad40c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:19 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Volume 9c73c7ef-deaf-41ae-afb2-3a197751c657: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c73c7ef-deaf-41ae-afb2-3a197751c657', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Trying to clone 9c73c7ef-deaf-41ae-afb2-3a197751c657 from image 728a9578-311c-407d-85c9-cd39797548f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:34:19 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Image download 20.69 MB at 20.69 MB/s Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d1002-22d7-434a-b61d-7be0dcd42b80]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:19 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD Nov 04 22:34:19 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:19 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 is fetched for user c770cf0f94ff4eecb7f37b4f3e48fffd. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[16354aab-a5b9-4795-a585-3e77e943cb5e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:19 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD Nov 04 22:34:19 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:20 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-988894179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c73c7ef-deaf-41ae-afb2-3a197751c657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afffb22d5772400d8a42ee2483dd6de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:19Z,use_quota=True,user_id='c770cf0f94ff4eecb7f37b4f3e48fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Creating volume 9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:20 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:20 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1073741824 Nov 04 22:34:20 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-49cfc663-404a-4ab0-8ed3-a8880dbc7f7f req-040919f7-412a-4994-a08a-fab8f3e78b03 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:20 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1073741824" returned: 0 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:20 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 Nov 04 22:34:20 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:21 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-49cfc663-404a-4ab0-8ed3-a8880dbc7f7f req-040919f7-412a-4994-a08a-fab8f3e78b03 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.422s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-49cfc663-404a-4ab0-8ed3-a8880dbc7f7f req-040919f7-412a-4994-a08a-fab8f3e78b03 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Attempting download of 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 9c73c7ef-deaf-41ae-afb2-3a197751c657. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-49cfc663-404a-4ab0-8ed3-a8880dbc7f7f req-040919f7-412a-4994-a08a-fab8f3e78b03 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-8f244053-a8bf-46d7-a9aa-522b499a1f37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecff4d65-4c43-4a8e-9650-2ee80dde58f0', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c3785f-8ecc-44de-b74a-ac86a78a1943]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-49cfc663-404a-4ab0-8ed3-a8880dbc7f7f req-040919f7-412a-4994-a08a-fab8f3e78b03 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] attachment_update completed successfully. Nov 04 22:34:21 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md Nov 04 22:34:21 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:21 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md" returned: 0 in 0.523s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:21 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md Nov 04 22:34:21 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:22 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md" returned: 1 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_728a9578-311c-407d-85c9-cd39797548f0_n1emo8md' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a204572-a374-42f2-b1de-932f0e2f6c13]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:22 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD Nov 04 22:34:22 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:22 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] 728a9578-311c-407d-85c9-cd39797548f0 was qcow2, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:34:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:22 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 Nov 04 22:34:22 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:24 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-1d47972d-38b9-423e-a8e9-519f2dbd1977 req-03933f8a-7513-4b14-8b90-79bf6028ca21 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Terminate volume connection completed successfully. Nov 04 22:34:24 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-1d47972d-38b9-423e-a8e9-519f2dbd1977 req-03933f8a-7513-4b14-8b90-79bf6028ca21 tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Deleting attachment ecff4d65-4c43-4a8e-9650-2ee80dde58f0. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:34:24 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657" returned: 0 in 2.362s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:24 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_728a9578-311c-407d-85c9-cd39797548f0_qtxtyixzdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:34:24 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Converted 112.00 MB image at 47.40 MB/s Nov 04 22:34:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:24 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1G Nov 04 22:34:24 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:25 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 1G" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Downloaded image 728a9578-311c-407d-85c9-cd39797548f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}])) to volume 9c73c7ef-deaf-41ae-afb2-3a197751c657 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Temporary image 728a9578-311c-407d-85c9-cd39797548f0 for user c770cf0f94ff4eecb7f37b4f3e48fffd is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Marking volume 9c73c7ef-deaf-41ae-afb2-3a197751c657 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Copying metadata from image 728a9578-311c-407d-85c9-cd39797548f0 to 9c73c7ef-deaf-41ae-afb2-3a197751c657. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Creating volume glance metadata for volume 9c73c7ef-deaf-41ae-afb2-3a197751c657 backed by image 728a9578-311c-407d-85c9-cd39797548f0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "cinder-8f244053-a8bf-46d7-a9aa-522b499a1f37-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "cinder-8f244053-a8bf-46d7-a9aa-522b499a1f37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "cinder-quobyte-8f244053-a8bf-46d7-a9aa-522b499a1f37" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6103c9c4-347c-4aa1-aae7-cc1a0ad40c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c73c7ef-deaf-41ae-afb2-3a197751c657', 'volume_size': 1, 'image_id': '728a9578-311c-407d-85c9-cd39797548f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/728a9578-311c-407d-85c9-cd39797548f0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64f90d86f93146cf89b18b1549320aa0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '728a9578-311c-407d-85c9-cd39797548f0', 'created_at': datetime.datetime(2026, 11, 4, 21, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/728a9578-311c-407d-85c9-cd39797548f0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f9804e-0dc0-40d5-a5fe-13dd198824e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:25 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Volume volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 (9c73c7ef-deaf-41ae-afb2-3a197751c657): created successfully Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f9804e-0dc0-40d5-a5fe-13dd198824e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Flow 'volume_create_manager' (6f2ca5bf-d068-4d51-b693-9d0c3620b0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "cinder-quobyte-8f244053-a8bf-46d7-a9aa-522b499a1f37" acquired by "delete_volume" :: waited 0.046s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:25 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-912ac262-7a66-42ec-bca1-91accde2b2b5 tempest-TestShelveInstance-1908422632 None] Created volume successfully. Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b597e5-bc11-4c1a-aef5-0320cfd175d7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:25 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 Nov 04 22:34:25 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:25 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:25 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37 Nov 04 22:34:25 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:26 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8f244053-a8bf-46d7-a9aa-522b499a1f37" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "cinder-quobyte-8f244053-a8bf-46d7-a9aa-522b499a1f37" released by "delete_volume" :: held 0.659s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Created reservations ['94e109c4-7673-4a38-ac97-58f61d2f4f87', '96b54d47-e6a2-4eeb-80c1-a268174f837c', '2349beed-bb66-420a-bea9-cbaa1dfe5a38', '0cba6a36-1f05-48d3-8834-f108cc97b5eb'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:26 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:26 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:26 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.274s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Deleted volume successfully. Nov 04 22:34:26 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-43d6d67b-2dd0-4ad7-b6d8-84f2eff382cc tempest-TestServerVolumeAttachScenarioOldVersion-105847069 None] Lock "cinder-8f244053-a8bf-46d7-a9aa-522b499a1f37-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-1c0b6279-2156-420a-b346-10f32db0ed78 req-333f2455-1f95-4438-86dc-3224610db4df tempest-TestShelveInstance-1908422632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-1c0b6279-2156-420a-b346-10f32db0ed78 req-333f2455-1f95-4438-86dc-3224610db4df tempest-TestShelveInstance-1908422632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-1c0b6279-2156-420a-b346-10f32db0ed78 req-333f2455-1f95-4438-86dc-3224610db4df tempest-TestShelveInstance-1908422632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-1c0b6279-2156-420a-b346-10f32db0ed78 req-333f2455-1f95-4438-86dc-3224610db4df tempest-TestShelveInstance-1908422632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-9c73c7ef-deaf-41ae-afb2-3a197751c657', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31f230f4-4e1a-48c1-97d3-a3c01fd16db4', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:34:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-1c0b6279-2156-420a-b346-10f32db0ed78 req-333f2455-1f95-4438-86dc-3224610db4df tempest-TestShelveInstance-1908422632 None] attachment_update completed successfully. Nov 04 22:34:39 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=48,cinder:UPDATE=46,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:34:39 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=47,cinder:UPDATE=39,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (884a84e7-85e7-46a0-aeec-805eaf6b52a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaf61be-48b6-42d1-9886-fb9a8ea71b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaf61be-48b6-42d1-9886-fb9a8ea71b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813778037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9abf5b-470f-435a-837d-a008a638f191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:44Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00cc0e5-156a-433b-8807-b9029498cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00cc0e5-156a-433b-8807-b9029498cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f43d12-a4ff-4563-9316-ba2d6cf60e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f43d12-a4ff-4563-9316-ba2d6cf60e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9abf5b-470f-435a-837d-a008a638f191', 'volume_name': 'volume-3d9abf5b-470f-435a-837d-a008a638f191', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a8da48-5164-480f-9ef0-f801bc0684c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a8da48-5164-480f-9ef0-f801bc0684c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110da85f-a4ff-4403-afe5-8869ee654b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume 3d9abf5b-470f-435a-837d-a008a638f191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9abf5b-470f-435a-837d-a008a638f191', 'volume_size': 1} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813778037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9abf5b-470f-435a-837d-a008a638f191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:44Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume 3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:44 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:44 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 1073741824 Nov 04 22:34:44 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:44 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 1073741824" returned: 0 in 0.473s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:44 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 Nov 04 22:34:44 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:45 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191" returned: 0 in 0.243s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110da85f-a4ff-4403-afe5-8869ee654b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9abf5b-470f-435a-837d-a008a638f191', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e962d359-42fc-46a4-ba3e-6d44a05186de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:45 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-3d9abf5b-470f-435a-837d-a008a638f191 (3d9abf5b-470f-435a-837d-a008a638f191): created successfully Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e962d359-42fc-46a4-ba3e-6d44a05186de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:45 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (884a84e7-85e7-46a0-aeec-805eaf6b52a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bb237d7a-0031-4ed8-a2c0-e9b144c1b61b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating offline snapshot aeb26425-4646-4533-8e48-af53dd56473b of volume 3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:34:46 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33fcb6e-3787-4fc9-9af6-9b73616e9599]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:46 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 Nov 04 22:34:46 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:47 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191" returned: 0 in 0.396s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:47 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b 1G Nov 04 22:34:47 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:47 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b 1G" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9abf5b-470f-435a-837d-a008a638f191 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:47 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9abf5b-470f-435a-837d-a008a638f191 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b Nov 04 22:34:47 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:47 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9abf5b-470f-435a-837d-a008a638f191 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:47 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b is being set with open permissions: ugo+rw Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:47 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b Nov 04 22:34:47 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:47 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:48 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info Nov 04 22:34:48 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:48 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info" returned: 0 in 0.271s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:48 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info is being set with open permissions: ugo+rw Nov 04 22:34:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:48 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info Nov 04 22:34:48 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:48 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.info" returned: 0 in 0.253s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-82c6d0ce-28b4-4160-9c70-8533008c3c30 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Create snapshot completed successfully Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (eb1fd64c-2d99-4624-8cfa-998a04fbc6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f10841-3e95-4e71-b87e-53925660b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f10841-3e95-4e71-b87e-53925660b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433333598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95da4e0b-d0e4-4dda-be1a-eee54882c4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:49Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dffc84-f2d3-4835-99c0-321e1e08554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dffc84-f2d3-4835-99c0-321e1e08554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279690b4-164d-489b-be09-25d1c1bc1f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279690b4-164d-489b-be09-25d1c1bc1f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95da4e0b-d0e4-4dda-be1a-eee54882c4dd', 'volume_name': 'volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcb2093-a6b8-4c49-b9fa-146ed3b56596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcb2093-a6b8-4c49-b9fa-146ed3b56596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad0be7-5c50-4b4e-bd6d-e62034630e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume 95da4e0b-d0e4-4dda-be1a-eee54882c4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd', 'volume_size': 1} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433333598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95da4e0b-d0e4-4dda-be1a-eee54882c4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:49Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume 95da4e0b-d0e4-4dda-be1a-eee54882c4dd {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:49 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:49 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd 1073741824 Nov 04 22:34:49 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (cc2f2cb2-55c0-4ec3-8000-51f96ea6af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defd7157-631b-4e45-99cd-1c1be01b8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defd7157-631b-4e45-99cd-1c1be01b8877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779262489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32234a62-140d-4ed1-bfff-0b46575ff6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8131ade1-9097-49f2-ac6f-724d95d893fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8131ade1-9097-49f2-ac6f-724d95d893fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef3a9b-fb85-4595-9b65-c4f414560aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef3a9b-fb85-4595-9b65-c4f414560aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32234a62-140d-4ed1-bfff-0b46575ff6ff', 'volume_name': 'volume-32234a62-140d-4ed1-bfff-0b46575ff6ff', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4541c7c7-cd08-4fbf-b0d8-0ff53ded655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4541c7c7-cd08-4fbf-b0d8-0ff53ded655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71023bb7-28ee-4d68-a3ec-5cb51fe20130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume 32234a62-140d-4ed1-bfff-0b46575ff6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32234a62-140d-4ed1-bfff-0b46575ff6ff', 'volume_size': 1} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:49 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd 1073741824" returned: 0 in 0.580s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:49 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd Nov 04 22:34:49 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (3dca83b3-b603-4f65-8a72-6bfb6f3a2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d518cf00-4519-4b5c-a40a-1fc63dfa08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d518cf00-4519-4b5c-a40a-1fc63dfa08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670995428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fd6734-66c2-4dff-a036-4595f25bed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b2390c-e684-4ddf-a533-78351db67af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b2390c-e684-4ddf-a533-78351db67af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7c0abd-0b1b-4f8d-afb6-68586585ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7c0abd-0b1b-4f8d-afb6-68586585ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fd6734-66c2-4dff-a036-4595f25bed92', 'volume_name': 'volume-b1fd6734-66c2-4dff-a036-4595f25bed92', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dba9b2-df03-41a7-a90f-2b702a292685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dba9b2-df03-41a7-a90f-2b702a292685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011aed81-da6a-4484-a9d9-a39371639106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume b1fd6734-66c2-4dff-a036-4595f25bed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fd6734-66c2-4dff-a036-4595f25bed92', 'volume_size': 1} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:50 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" returned: 0 in 0.395s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779262489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32234a62-140d-4ed1-bfff-0b46575ff6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume 32234a62-140d-4ed1-bfff-0b46575ff6ff {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:50 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ad0be7-5c50-4b4e-bd6d-e62034630e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff 1073741824 Nov 04 22:34:50 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1832d3a6-fd2c-4048-9e1b-d853b8163207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd (95da4e0b-d0e4-4dda-be1a-eee54882c4dd): created successfully Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1832d3a6-fd2c-4048-9e1b-d853b8163207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (eb1fd64c-2d99-4624-8cfa-998a04fbc6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e70287fe-0207-41a6-b536-914a52960faa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (5841705f-c9b5-4cad-a990-9b6dd6c011f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b179ee-57a0-4fa1-beaa-59e37df5a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b179ee-57a0-4fa1-beaa-59e37df5a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750060191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57def166-7f5a-43a9-9c4b-6eab950abb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0384a08b-2cd7-437f-a636-a77a48157c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0384a08b-2cd7-437f-a636-a77a48157c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0535a3b4-262f-468d-aa1a-6b2797687779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0535a3b4-262f-468d-aa1a-6b2797687779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57def166-7f5a-43a9-9c4b-6eab950abb95', 'volume_name': 'volume-57def166-7f5a-43a9-9c4b-6eab950abb95', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d201651-7c6c-44fa-b269-4675740ddef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d201651-7c6c-44fa-b269-4675740ddef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238ddb1-48be-4a0b-9b99-144c314c1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume 57def166-7f5a-43a9-9c4b-6eab950abb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57def166-7f5a-43a9-9c4b-6eab950abb95', 'volume_size': 1} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (61921a7a-b550-45c1-ac17-c77b8ffcdffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ff845d-3ca8-4f37-b367-e996bf337aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:50 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff 1073741824" returned: 0 in 0.630s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ff845d-3ca8-4f37-b367-e996bf337aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175093730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3866cc58-f607-4e98-a655-fa96e1d95387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:51Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d973265-ba28-4ad2-addb-c057d6f38c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d973265-ba28-4ad2-addb-c057d6f38c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89166eeb-eaca-4653-b1f0-4653c5bcb2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89166eeb-eaca-4653-b1f0-4653c5bcb2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3866cc58-f607-4e98-a655-fa96e1d95387', 'volume_name': 'volume-3866cc58-f607-4e98-a655-fa96e1d95387', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a4ed4-7a44-459e-b0a2-15482d9f97ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a4ed4-7a44-459e-b0a2-15482d9f97ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7bde62-eca9-499e-a682-b08f9e69b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume 3866cc58-f607-4e98-a655-fa96e1d95387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3866cc58-f607-4e98-a655-fa96e1d95387', 'volume_size': 1} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:51 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff Nov 04 22:34:51 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:51 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670995428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fd6734-66c2-4dff-a036-4595f25bed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume b1fd6734-66c2-4dff-a036-4595f25bed92 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:51 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71023bb7-28ee-4d68-a3ec-5cb51fe20130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32234a62-140d-4ed1-bfff-0b46575ff6ff', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c051cc-c247-48ea-bf35-84f99510fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:51 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 1073741824 Nov 04 22:34:51 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-32234a62-140d-4ed1-bfff-0b46575ff6ff (32234a62-140d-4ed1-bfff-0b46575ff6ff): created successfully Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c051cc-c247-48ea-bf35-84f99510fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (cc2f2cb2-55c0-4ec3-8000-51f96ea6af99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8ccf3737-8653-4bad-90e0-7e954ec40ff0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:51 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 1073741824" returned: 0 in 0.412s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:51 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 Nov 04 22:34:51 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:52 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92" returned: 0 in 0.245s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750060191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57def166-7f5a-43a9-9c4b-6eab950abb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:50Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume 57def166-7f5a-43a9-9c4b-6eab950abb95 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011aed81-da6a-4484-a9d9-a39371639106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fd6734-66c2-4dff-a036-4595f25bed92', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:52 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 1073741824 Nov 04 22:34:52 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e8d7dc-a7cf-48f3-92b2-24c3778b781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-b1fd6734-66c2-4dff-a036-4595f25bed92 (b1fd6734-66c2-4dff-a036-4595f25bed92): created successfully Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e8d7dc-a7cf-48f3-92b2-24c3778b781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (3dca83b3-b603-4f65-8a72-6bfb6f3a2de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b46a5832-da86-4156-98ec-6badf454cbf0 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:52 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 1073741824" returned: 0 in 0.409s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:52 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 Nov 04 22:34:52 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:52 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95" returned: 0 in 0.247s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175093730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3866cc58-f607-4e98-a655-fa96e1d95387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9158de84ad456b9a7707ba7ae0d657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:34:51Z,use_quota=True,user_id='1dba4afb39f44959a94dba4a9df4579f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Creating volume 3866cc58-f607-4e98-a655-fa96e1d95387 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:52 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 1073741824 Nov 04 22:34:52 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238ddb1-48be-4a0b-9b99-144c314c1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57def166-7f5a-43a9-9c4b-6eab950abb95', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c144f4f0-cef6-49f8-928a-a12ba1f6c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-57def166-7f5a-43a9-9c4b-6eab950abb95 (57def166-7f5a-43a9-9c4b-6eab950abb95): created successfully Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c144f4f0-cef6-49f8-928a-a12ba1f6c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (5841705f-c9b5-4cad-a990-9b6dd6c011f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-84d6af30-25dc-441e-8fba-34bcf488f87c tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:53 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 1073741824" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:53 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 Nov 04 22:34:53 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:53 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387" returned: 0 in 0.234s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7bde62-eca9-499e-a682-b08f9e69b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3866cc58-f607-4e98-a655-fa96e1d95387', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8ea36-c884-43f3-92e3-321ee5d50f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:34:53 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Volume volume-3866cc58-f607-4e98-a655-fa96e1d95387 (3866cc58-f607-4e98-a655-fa96e1d95387): created successfully Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8ea36-c884-43f3-92e3-321ee5d50f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:34:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Flow 'volume_create_manager' (61921a7a-b550-45c1-ac17-c77b8ffcdffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:34:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-154f9813-4403-4af5-880b-2d2fee29d5fa tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created volume successfully. Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-3866cc58-f607-4e98-a655-fa96e1d95387-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-3866cc58-f607-4e98-a655-fa96e1d95387-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-3866cc58-f607-4e98-a655-fa96e1d95387" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3866cc58-f607-4e98-a655-fa96e1d95387" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a1761-9d81-4d1a-9c5d-7148fd908256]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:54 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 Nov 04 22:34:54 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:54 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387" returned: 0 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:54 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387 Nov 04 22:34:54 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:54 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3866cc58-f607-4e98-a655-fa96e1d95387" returned: 0 in 0.233s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3866cc58-f607-4e98-a655-fa96e1d95387" released by "delete_volume" :: held 0.627s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['fe973856-32ab-4f9a-a5cf-fba5313db7c0', '1329ea0b-167c-4be3-8a81-a70e08fa024c', 'c60d67ad-993c-4b2e-9478-c536b7ee9d8f', 'b886d77c-bcb4-4506-bd3a-b8ed048cfa54'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:55 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:55 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:55 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-180b9ce3-cf8a-4a59-b8a8-038ff5c0868d tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-3866cc58-f607-4e98-a655-fa96e1d95387-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-57def166-7f5a-43a9-9c4b-6eab950abb95-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-57def166-7f5a-43a9-9c4b-6eab950abb95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-57def166-7f5a-43a9-9c4b-6eab950abb95" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-57def166-7f5a-43a9-9c4b-6eab950abb95" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9d7f5-c1bd-465d-aec5-754c62f068ad]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:55 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 Nov 04 22:34:55 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:55 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95" returned: 0 in 0.360s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:55 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95 Nov 04 22:34:55 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:56 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-57def166-7f5a-43a9-9c4b-6eab950abb95" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-57def166-7f5a-43a9-9c4b-6eab950abb95" released by "delete_volume" :: held 0.680s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['b7d4ef47-55d6-4228-8679-509b6e552677', 'bdfe860c-302b-4775-9d04-971e16dadccc', 'd8569547-48f8-4613-984b-742f7cd32d01', '58538ecc-fb9a-4901-95c7-66d7b57ef2a7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:56 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:56 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-b1fd6734-66c2-4dff-a036-4595f25bed92-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:56 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.336s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:56 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-b1fd6734-66c2-4dff-a036-4595f25bed92-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:56 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9c1d4c10-3f05-4328-88f8-8efb3ef34d25 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-57def166-7f5a-43a9-9c4b-6eab950abb95-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-b1fd6734-66c2-4dff-a036-4595f25bed92" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-b1fd6734-66c2-4dff-a036-4595f25bed92" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ddd22f-0bdb-47f9-a886-254ad2d0bfef]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:56 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 Nov 04 22:34:56 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:56 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:34:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:34:57 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:57 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92 Nov 04 22:34:57 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:57 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b1fd6734-66c2-4dff-a036-4595f25bed92" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-b1fd6734-66c2-4dff-a036-4595f25bed92" released by "delete_volume" :: held 0.658s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['35838ce3-9b1a-4a61-8602-172ee62155e6', '60e467c7-a210-47c0-b0cc-88819ca16aa8', 'aa9c50be-1360-4b3b-bb5e-28bc7abc8f8a', '2d6b7efd-2de3-435a-934f-1b0c0681301e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:57 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:57 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:57 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.263s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-32234a62-140d-4ed1-bfff-0b46575ff6ff-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ac61c36d-0067-4f09-8582-4af6e2c7a008 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-b1fd6734-66c2-4dff-a036-4595f25bed92-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-32234a62-140d-4ed1-bfff-0b46575ff6ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-32234a62-140d-4ed1-bfff-0b46575ff6ff" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-32234a62-140d-4ed1-bfff-0b46575ff6ff" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06b7b89-ee01-46cb-94dd-8dd9f5a51355]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:58 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff Nov 04 22:34:58 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:58 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff" returned: 0 in 0.387s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:58 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff Nov 04 22:34:58 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:58 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32234a62-140d-4ed1-bfff-0b46575ff6ff" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-32234a62-140d-4ed1-bfff-0b46575ff6ff" released by "delete_volume" :: held 0.685s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['81d71120-12c9-4e88-a612-bd4e21c3c0fe', 'd0bf23ff-3eb9-4752-a486-b7bf1876935b', '1f26a7ff-b1a4-4358-83be-cae69c402529', 'e48d8c1e-523f-4696-887d-704d6a19b7ab'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:58 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:58 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:59 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-95da4e0b-d0e4-4dda-be1a-eee54882c4dd-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:34:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-95da4e0b-d0e4-4dda-be1a-eee54882c4dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-01609243-365c-4253-8142-29874a58c797 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-32234a62-140d-4ed1-bfff-0b46575ff6ff-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df2e0a-3896-48d2-bdfc-039b86ec4f21]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:59 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd Nov 04 22:34:59 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:59 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" returned: 0 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:59 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd Nov 04 22:34:59 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:34:59 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-95da4e0b-d0e4-4dda-be1a-eee54882c4dd" released by "delete_volume" :: held 0.710s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['6a58e2f1-c05a-4628-9d48-2d08aa98cab8', '02501d7a-0b85-45f7-8d00-cfcbcaa7abfe', 'dbb813f0-380c-44fa-8d52-89d75d2d3343', '005a3a93-06e9-4721-9ad1-c3f71dd4bbbc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:34:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:34:59 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:34:59 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:00 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-aeb26425-4646-4533-8e48-af53dd56473b-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-aeb26425-4646-4533-8e48-af53dd56473b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-aeb26425-4646-4533-8e48-af53dd56473b" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-956e7264-d75c-4b10-97c3-e89f0335984b tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-95da4e0b-d0e4-4dda-be1a-eee54882c4dd-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-aeb26425-4646-4533-8e48-af53dd56473b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleting offline snapshot aeb26425-4646-4533-8e48-af53dd56473b of volume 3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] snapshot_file for this snap is: volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c491d62c-e131-4f95-b5ee-fd0d66b6b5aa]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:00 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b Nov 04 22:35:00 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:00 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d9abf5b-470f-435a-837d-a008a638f191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d184f-c4e5-4fc3-a955-333ab6e2ce11]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:00 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 Nov 04 22:35:00 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:01 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:01 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b Nov 04 22:35:01 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:01 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:01 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b Nov 04 22:35:01 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:01 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191.aeb26425-4646-4533-8e48-af53dd56473b" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-aeb26425-4646-4533-8e48-af53dd56473b" released by "_delete_snapshot" :: held 1.510s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" released by "delete_snapshot" :: held 1.533s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['20af1edf-2c69-42cf-8d4c-86d4e7ada543', '3d93888c-e1a5-4aed-a213-196123c87579', 'a2a4c468-577a-4060-9d7d-6986c8c814bd', 'cb056b44-f08b-4832-b5bb-a08e75158b59'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:01 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Delete snapshot completed successfully. Nov 04 22:35:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c4df9142-66bb-49fa-950c-9743aec28621 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-aeb26425-4646-4533-8e48-af53dd56473b-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-3d9abf5b-470f-435a-837d-a008a638f191-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-3d9abf5b-470f-435a-837d-a008a638f191-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c8482e-0c68-47be-94cd-6ed5cd4c85ac]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:02 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 Nov 04 22:35:02 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:03 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191" returned: 0 in 0.545s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:03 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191 Nov 04 22:35:03 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-3c4e927a-2e83-4759-a33a-9e93400984f4 req-5f6c5a1b-cb74-4bd1-9bd8-48dd274dc115 tempest-TestShelveInstance-1908422632 None] Terminate volume connection completed successfully. Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-3c4e927a-2e83-4759-a33a-9e93400984f4 req-5f6c5a1b-cb74-4bd1-9bd8-48dd274dc115 tempest-TestShelveInstance-1908422632 None] Deleting attachment 31f230f4-4e1a-48c1-97d3-a3c01fd16db4. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:35:03 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d9abf5b-470f-435a-837d-a008a638f191" returned: 0 in 0.323s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-quobyte-3d9abf5b-470f-435a-837d-a008a638f191" released by "delete_volume" :: held 0.958s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Created reservations ['55d2aa2a-ecdf-4787-81af-8a72dcdcce6b', 'aac04550-e28e-45c1-8d07-d9bf2923cc61', '0d5466c7-afb9-4f1e-ba65-5cbb47e155a9', '1b40d126-f7ea-49f8-beea-5480b70c6f46'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:03 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:03 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:03 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Deleted volume successfully. Nov 04 22:35:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5f8b7d62-c8ca-4691-883e-1c11605f1d10 tempest-CreateVolumesFromSnapshotTest-1472740999 None] Lock "cinder-3d9abf5b-470f-435a-837d-a008a638f191-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-af6f8145-edcd-4143-84ee-589d9cbb9ef7 req-8bfbe44a-e504-45c4-be0e-9066ff25d6a3 tempest-TestShelveInstance-1908422632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-af6f8145-edcd-4143-84ee-589d9cbb9ef7 req-8bfbe44a-e504-45c4-be0e-9066ff25d6a3 tempest-TestShelveInstance-1908422632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-af6f8145-edcd-4143-84ee-589d9cbb9ef7 req-8bfbe44a-e504-45c4-be0e-9066ff25d6a3 tempest-TestShelveInstance-1908422632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-af6f8145-edcd-4143-84ee-589d9cbb9ef7 req-8bfbe44a-e504-45c4-be0e-9066ff25d6a3 tempest-TestShelveInstance-1908422632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1', 'name': 'volume-9c73c7ef-deaf-41ae-afb2-3a197751c657', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb907a0d-5d3d-499f-b5bb-0fa42d74fb19', 'enforce_multipath': True} {{(pid=87173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 22:35:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-af6f8145-edcd-4143-84ee-589d9cbb9ef7 req-8bfbe44a-e504-45c4-be0e-9066ff25d6a3 tempest-TestShelveInstance-1908422632 None] attachment_update completed successfully. Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (a81eece7-4c99-4008-bed9-2295350a5134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628ec2c7-7f23-41d7-9499-c515d72b85ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628ec2c7-7f23-41d7-9499-c515d72b85ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246614866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806e6537-dfc8-499a-943a-1ccdf578f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:08Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac8ad8d-df50-4ef9-bcf0-f0630b998520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac8ad8d-df50-4ef9-bcf0-f0630b998520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfd02fb-1130-4f88-bbf2-57da2c046f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfd02fb-1130-4f88-bbf2-57da2c046f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806e6537-dfc8-499a-943a-1ccdf578f806', 'volume_name': 'volume-806e6537-dfc8-499a-943a-1ccdf578f806', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea86455-52d0-4ab2-8dc5-9143001d3830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea86455-52d0-4ab2-8dc5-9143001d3830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbddfa-d80a-49c7-a627-0c3ce3cbc899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume 806e6537-dfc8-499a-943a-1ccdf578f806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806e6537-dfc8-499a-943a-1ccdf578f806', 'volume_size': 1} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246614866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806e6537-dfc8-499a-943a-1ccdf578f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:08Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume 806e6537-dfc8-499a-943a-1ccdf578f806 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:07 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:07 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 1073741824 Nov 04 22:35:07 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:08 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 1073741824" returned: 0 in 0.721s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:08 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 Nov 04 22:35:08 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:08 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbddfa-d80a-49c7-a627-0c3ce3cbc899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806e6537-dfc8-499a-943a-1ccdf578f806', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da9a3d-59a5-46ca-8295-00eb8b4217af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-806e6537-dfc8-499a-943a-1ccdf578f806 (806e6537-dfc8-499a-943a-1ccdf578f806): created successfully Nov 04 22:35:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da9a3d-59a5-46ca-8295-00eb8b4217af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (a81eece7-4c99-4008-bed9-2295350a5134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3d31d9c1-4d17-4340-95ec-6dc7245364c4 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (8590dc07-ef13-4a96-a61c-9ada8237865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50289444-0a06-44a4-847f-d1f4eb1949ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50289444-0a06-44a4-847f-d1f4eb1949ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753488247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a38ed8-3d1a-42e2-b228-b8263dc9a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:10Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d548e08-dc4d-4461-99ad-6f94768704d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d548e08-dc4d-4461-99ad-6f94768704d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce64ab-65c6-4a46-8001-1d94d28e9ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce64ab-65c6-4a46-8001-1d94d28e9ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a38ed8-3d1a-42e2-b228-b8263dc9a3f7', 'volume_name': 'volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f098dc-3e80-4493-a846-90322ac1e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f098dc-3e80-4493-a846-90322ac1e43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4526bb03-b7bc-4400-8258-ec3fa2d458d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume 75a38ed8-3d1a-42e2-b228-b8263dc9a3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7', 'volume_size': 1} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753488247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a38ed8-3d1a-42e2-b228-b8263dc9a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:10Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume 75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:10 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 1073741824 Nov 04 22:35:10 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:10 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (fdcaf2b8-1bdc-496c-abcb-590cd17a53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a99f76-6e9b-4cc8-abb8-e980e1860077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a99f76-6e9b-4cc8-abb8-e980e1860077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557981305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936086e0-ca33-476a-ae01-a4ff426de824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:11Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc468cf-24bd-4be7-b9ee-79c3a4f5d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc468cf-24bd-4be7-b9ee-79c3a4f5d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6536ec9-7548-4109-bf3a-25a0eb97ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6536ec9-7548-4109-bf3a-25a0eb97ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936086e0-ca33-476a-ae01-a4ff426de824', 'volume_name': 'volume-936086e0-ca33-476a-ae01-a4ff426de824', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403beddb-6d38-4c33-8159-71e8e03e3b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403beddb-6d38-4c33-8159-71e8e03e3b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558c9fb1-4795-4f1b-8e9b-5cd97d1b006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume 936086e0-ca33-476a-ae01-a4ff426de824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936086e0-ca33-476a-ae01-a4ff426de824', 'volume_size': 1} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:11 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 1073741824" returned: 0 in 0.713s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:11 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 Nov 04 22:35:11 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:11 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" returned: 0 in 0.303s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557981305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936086e0-ca33-476a-ae01-a4ff426de824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:11Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume 936086e0-ca33-476a-ae01-a4ff426de824 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:11 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:11 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 1073741824 Nov 04 22:35:11 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4526bb03-b7bc-4400-8258-ec3fa2d458d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e039c-6734-4e18-b7cc-49e3657fc2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 (75a38ed8-3d1a-42e2-b228-b8263dc9a3f7): created successfully Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e039c-6734-4e18-b7cc-49e3657fc2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (8590dc07-ef13-4a96-a61c-9ada8237865c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (9d8b82ac-2035-4781-a53f-4fe9f9fdb36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fb814-dfae-40f9-ad67-d49d4e1d322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b316019a-e363-4988-b964-0aaffffec59b tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fb814-dfae-40f9-ad67-d49d4e1d322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197773163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c819eb2-9751-4d7e-b814-f246471d49f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:11Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb331cf6-ce92-44e3-bd40-b3e4ab1995a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb331cf6-ce92-44e3-bd40-b3e4ab1995a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafa387-aa57-469e-88f8-26bc096d31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafa387-aa57-469e-88f8-26bc096d31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c819eb2-9751-4d7e-b814-f246471d49f0', 'volume_name': 'volume-4c819eb2-9751-4d7e-b814-f246471d49f0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17c965c-982f-475c-9749-e7bf4ef3c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17c965c-982f-475c-9749-e7bf4ef3c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac6d65-e634-4221-b1f5-3048d073085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume 4c819eb2-9751-4d7e-b814-f246471d49f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c819eb2-9751-4d7e-b814-f246471d49f0', 'volume_size': 1} Nov 04 22:35:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:12 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (12bcf4d8-d919-46e8-965a-183ac9d9089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e909a53-7326-41dd-b559-f544fe3ca201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 1073741824" returned: 0 in 0.650s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e909a53-7326-41dd-b559-f544fe3ca201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423399759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d4822-e748-443c-8e71-cf6207974e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:12Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5564272-bdf6-4804-bfd9-5db6bb01bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5564272-bdf6-4804-bfd9-5db6bb01bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e7ed0a-6d9b-4ddf-9e7a-0f0b7145c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e7ed0a-6d9b-4ddf-9e7a-0f0b7145c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3d4822-e748-443c-8e71-cf6207974e78', 'volume_name': 'volume-fa3d4822-e748-443c-8e71-cf6207974e78', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75485652-b986-4a14-8704-151476d34167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75485652-b986-4a14-8704-151476d34167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa94e1-dac6-4e2f-8017-7c221557c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume fa3d4822-e748-443c-8e71-cf6207974e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3d4822-e748-443c-8e71-cf6207974e78', 'volume_size': 1} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:12 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 Nov 04 22:35:12 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:12 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197773163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c819eb2-9751-4d7e-b814-f246471d49f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:11Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume 4c819eb2-9751-4d7e-b814-f246471d49f0 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:12 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:12 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 1073741824 Nov 04 22:35:12 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558c9fb1-4795-4f1b-8e9b-5cd97d1b006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936086e0-ca33-476a-ae01-a4ff426de824', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6791567-5323-4714-bc27-b820f549af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (c0fb4010-2b03-4faf-99a6-16b024207c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6605322b-6ba3-41e0-a1b7-dd4f2983405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-936086e0-ca33-476a-ae01-a4ff426de824 (936086e0-ca33-476a-ae01-a4ff426de824): created successfully Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6791567-5323-4714-bc27-b820f549af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (fdcaf2b8-1bdc-496c-abcb-590cd17a53cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6605322b-6ba3-41e0-a1b7-dd4f2983405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734422032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7226f998-e313-47d6-bec3-d2c515d79c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:13Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16624b38-713a-4aef-8e63-c13902b44784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16624b38-713a-4aef-8e63-c13902b44784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abb6046-25e6-4749-b73a-5d572c2863de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abb6046-25e6-4749-b73a-5d572c2863de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7226f998-e313-47d6-bec3-d2c515d79c8b', 'volume_name': 'volume-7226f998-e313-47d6-bec3-d2c515d79c8b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ce5c1-7130-475d-8be0-2782b8e0fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ce5c1-7130-475d-8be0-2782b8e0fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041bf35d-adab-46b8-ac7a-6b6591d78712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume 7226f998-e313-47d6-bec3-d2c515d79c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7226f998-e313-47d6-bec3-d2c515d79c8b', 'volume_size': 1} Nov 04 22:35:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1e19b388-45fd-4781-a8e4-5811826b8705 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:13 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 1073741824" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:13 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 Nov 04 22:35:13 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:13 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423399759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d4822-e748-443c-8e71-cf6207974e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:12Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume fa3d4822-e748-443c-8e71-cf6207974e78 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:13 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:13 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 1073741824 Nov 04 22:35:13 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac6d65-e634-4221-b1f5-3048d073085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c819eb2-9751-4d7e-b814-f246471d49f0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b6af7e-5a8e-4e54-9498-fb3c4aa1609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:13 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-4c819eb2-9751-4d7e-b814-f246471d49f0 (4c819eb2-9751-4d7e-b814-f246471d49f0): created successfully Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b6af7e-5a8e-4e54-9498-fb3c4aa1609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (9d8b82ac-2035-4781-a53f-4fe9f9fdb36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-eb4f0739-77f6-46a4-84fe-9361c014cb87 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:13 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 1073741824" returned: 0 in 0.480s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:13 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 Nov 04 22:35:13 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:14 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734422032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7226f998-e313-47d6-bec3-d2c515d79c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9387c2b9eb4354aab625d0885f72dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:13Z,use_quota=True,user_id='ff89483f3f8b4334a615892018893eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Creating volume 7226f998-e313-47d6-bec3-d2c515d79c8b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:14 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa94e1-dac6-4e2f-8017-7c221557c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3d4822-e748-443c-8e71-cf6207974e78', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9a33b3-5553-4cac-8ec9-01a78dda5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:14 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b 1073741824 Nov 04 22:35:14 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-fa3d4822-e748-443c-8e71-cf6207974e78 (fa3d4822-e748-443c-8e71-cf6207974e78): created successfully Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9a33b3-5553-4cac-8ec9-01a78dda5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (12bcf4d8-d919-46e8-965a-183ac9d9089b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-cf69bced-3fd5-498c-96cd-b9010d759337 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:14 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b 1073741824" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:14 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b Nov 04 22:35:14 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:14 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041bf35d-adab-46b8-ac7a-6b6591d78712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7226f998-e313-47d6-bec3-d2c515d79c8b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e427f60f-e389-4dcd-af7b-14c9c5810638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Volume volume-7226f998-e313-47d6-bec3-d2c515d79c8b (7226f998-e313-47d6-bec3-d2c515d79c8b): created successfully Nov 04 22:35:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e427f60f-e389-4dcd-af7b-14c9c5810638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Flow 'volume_create_manager' (c0fb4010-2b03-4faf-99a6-16b024207c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-062f361d-88f1-47b8-a743-df3eeec2a599 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created volume successfully. Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-7226f998-e313-47d6-bec3-d2c515d79c8b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-7226f998-e313-47d6-bec3-d2c515d79c8b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-7226f998-e313-47d6-bec3-d2c515d79c8b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-7226f998-e313-47d6-bec3-d2c515d79c8b" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff70061f-4b75-4be8-8549-a923e24d1303]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:16 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b Nov 04 22:35:16 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:16 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:16 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b Nov 04 22:35:16 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:16 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7226f998-e313-47d6-bec3-d2c515d79c8b" returned: 0 in 0.245s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-7226f998-e313-47d6-bec3-d2c515d79c8b" released by "delete_volume" :: held 0.670s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['40b783b7-3406-4b2c-8163-da795f40ada3', 'bccdc040-b3ed-4fc4-af24-3d8b8275dc52', 'bae18a4e-fc0b-4bb5-abcf-2e6593aefd23', '5274d711-c35e-472d-9ad0-5c02b0a3b835'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:16 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:16 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:17 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-46743a32-c069-48e3-a6c1-ec8bc57ab389 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-7226f998-e313-47d6-bec3-d2c515d79c8b-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-fa3d4822-e748-443c-8e71-cf6207974e78-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-fa3d4822-e748-443c-8e71-cf6207974e78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-fa3d4822-e748-443c-8e71-cf6207974e78" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-fa3d4822-e748-443c-8e71-cf6207974e78" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9558dd9-dc95-4c4f-be06-cd2f44ba75dd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:17 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 Nov 04 22:35:17 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:17 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78" returned: 0 in 0.404s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:17 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78 Nov 04 22:35:17 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:18 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-fa3d4822-e748-443c-8e71-cf6207974e78" returned: 0 in 0.252s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-fa3d4822-e748-443c-8e71-cf6207974e78" released by "delete_volume" :: held 0.705s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['30758038-2407-4046-8be4-c0f0ec7c8cd7', '3701ea39-3407-4b2c-b47b-318b7d582956', '8088b9d0-b7dc-4115-8dc8-58727da3921c', 'b89a3708-50d8-4a11-bdba-1e753dee2ff9'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:18 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:18 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-4c819eb2-9751-4d7e-b814-f246471d49f0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:18 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.288s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-4c819eb2-9751-4d7e-b814-f246471d49f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d76a3b76-c767-47c5-8321-6885338666c2 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-fa3d4822-e748-443c-8e71-cf6207974e78-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-4c819eb2-9751-4d7e-b814-f246471d49f0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-4c819eb2-9751-4d7e-b814-f246471d49f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7be2b0-ddc9-4221-9448-d7c6e54be98a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:18 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 Nov 04 22:35:18 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:18 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:18 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0 Nov 04 22:35:18 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:19 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4c819eb2-9751-4d7e-b814-f246471d49f0" returned: 0 in 0.253s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-4c819eb2-9751-4d7e-b814-f246471d49f0" released by "delete_volume" :: held 0.671s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['79bfc2ab-8064-426a-a087-0d45a502f26e', '4944fe04-c36d-42fb-87db-aeca18aa8002', '157db944-5358-4fdc-8edd-7923ef972540', '703d8335-dada-43b0-9a49-1bd12e29f30c'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:19 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:19 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:19 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.262s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41d3f91b-c370-4d39-a53e-47675eb62130 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-4c819eb2-9751-4d7e-b814-f246471d49f0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-936086e0-ca33-476a-ae01-a4ff426de824-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-936086e0-ca33-476a-ae01-a4ff426de824-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-936086e0-ca33-476a-ae01-a4ff426de824" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-936086e0-ca33-476a-ae01-a4ff426de824" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[05696060-f6ba-4075-b4e2-4ca47afb4730]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:19 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 Nov 04 22:35:19 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:20 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824" returned: 0 in 0.378s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:20 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824 Nov 04 22:35:20 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:20 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-936086e0-ca33-476a-ae01-a4ff426de824" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-936086e0-ca33-476a-ae01-a4ff426de824" released by "delete_volume" :: held 0.675s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['afab03c4-ae97-4a37-aed0-995857fbced1', '75a7430c-1368-49d7-bd3b-9a9d8003b94a', 'aee5537b-c7c3-443c-92df-45b444312c12', 'bbc237bb-8a1b-4b4f-adcc-081db1f77623'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:20 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:20 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:20 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:20 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-41637f9e-bf3e-4d11-8d67-285c63d34f82 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-936086e0-ca33-476a-ae01-a4ff426de824-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0ee48-ff16-4dc7-8314-e2d15323febf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:21 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 Nov 04 22:35:21 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:21 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" returned: 0 in 0.351s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:21 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7 Nov 04 22:35:21 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:21 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7" released by "delete_volume" :: held 0.654s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['35ace2d4-4021-407f-a36e-2881ff86c066', '47bd40ad-a6cb-43c8-8049-afd531d6a24e', 'c8d3be5e-21a2-4208-83cd-cbdce6daaf42', '3ec149a4-966b-4f2a-b098-188a72cfeeeb'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:21 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:21 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:22 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f07f3070-a46b-4e2b-be70-1e3ab061c244 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-75a38ed8-3d1a-42e2-b228-b8263dc9a3f7-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-806e6537-dfc8-499a-943a-1ccdf578f806-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-806e6537-dfc8-499a-943a-1ccdf578f806-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "cinder-quobyte-806e6537-dfc8-499a-943a-1ccdf578f806" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-806e6537-dfc8-499a-943a-1ccdf578f806" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d9053-a070-4f79-9b78-aeee1b18e5a0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:22 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 Nov 04 22:35:22 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:22 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:22 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806 Nov 04 22:35:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:22 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-806e6537-dfc8-499a-943a-1ccdf578f806" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-quobyte-806e6537-dfc8-499a-943a-1ccdf578f806" released by "delete_volume" :: held 0.670s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Created reservations ['d79c3303-9e5f-4b33-a37b-f0edcec71415', '717c9720-7fdc-4b43-b64b-9c924b877cf3', '6c3f3e15-3a15-44dd-95fe-23f6cd073a40', '2a574d31-273f-49f2-9d0b-4943992245ee'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:22 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:22 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:23 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.256s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:23 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Deleted volume successfully. Nov 04 22:35:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2619a52b-37d6-434f-aa1b-d04e40168451 tempest-CreateVolumesFromSourceVolumeTest-1027185167 None] Lock "cinder-806e6537-dfc8-499a-943a-1ccdf578f806-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Flow 'volume_create_manager' (c83c9f4c-836f-4e64-a6e6-80c29602f042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9067d541-09c4-4760-8c4e-693274acc33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9067d541-09c4-4760-8c4e-693274acc33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187591547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb03ef6-8d50-4bbd-9c3b-7b3b23da8076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be94ff24d45a40b6b5516838c5cb7379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:26Z,use_quota=True,user_id='fc8c8547b372496aa3d3353dc13ce32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6a32d7-c9e4-4890-8716-f9e831512999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6a32d7-c9e4-4890-8716-f9e831512999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55df5142-2318-4823-a040-2987e6a71bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55df5142-2318-4823-a040-2987e6a71bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb03ef6-8d50-4bbd-9c3b-7b3b23da8076', 'volume_name': 'volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58882816-113b-4ce4-872b-c26b0ffa247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58882816-113b-4ce4-872b-c26b0ffa247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070d3b78-53d8-48ed-98f4-a843d37ee960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:26 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Volume edb03ef6-8d50-4bbd-9c3b-7b3b23da8076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076', 'volume_size': 1} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187591547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb03ef6-8d50-4bbd-9c3b-7b3b23da8076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be94ff24d45a40b6b5516838c5cb7379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:26Z,use_quota=True,user_id='fc8c8547b372496aa3d3353dc13ce32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Creating volume edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:26 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:26 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 1073741824 Nov 04 22:35:26 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:26 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 1073741824" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:26 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:26 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:26 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:27 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070d3b78-53d8-48ed-98f4-a843d37ee960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7511aa37-801b-42f8-98d8-e2e53fc4d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:27 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Volume volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 (edb03ef6-8d50-4bbd-9c3b-7b3b23da8076): created successfully Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7511aa37-801b-42f8-98d8-e2e53fc4d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Flow 'volume_create_manager' (c83c9f4c-836f-4e64-a6e6-80c29602f042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:27 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4cd7636e-80ac-4fff-b95d-8eba7a1f4045 tempest-VolumeDependencyTests-200517098 None] Created volume successfully. Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Creating offline snapshot dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d of volume edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3287b3c-2d3b-47ce-b6e2-07efee3fb612]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:27 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:27 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:27 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.377s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:27 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d 1G Nov 04 22:35:27 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:28 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d 1G" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:28 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:28 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:28 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.287s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:28 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d is being set with open permissions: ugo+rw Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:28 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:28 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:28 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.244s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:28 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info Nov 04 22:35:28 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:29 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:29 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info is being set with open permissions: ugo+rw Nov 04 22:35:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:29 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info Nov 04 22:35:29 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:29 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.info" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fe539171-3916-4846-8fcd-bc785173aebc tempest-VolumeDependencyTests-200517098 None] Create snapshot completed successfully Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Flow 'volume_create_manager' (1552aff8-c970-479c-a3c4-dfc3cd66be4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88b8fee-0f1f-4dd8-8bf6-8fd0f9e92e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88b8fee-0f1f-4dd8-8bf6-8fd0f9e92e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1028292669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fba535c-6df1-48a7-9cdf-a52a61fa03a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be94ff24d45a40b6b5516838c5cb7379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:30Z,use_quota=True,user_id='fc8c8547b372496aa3d3353dc13ce32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de26fd09-23f9-48fc-b907-c234a2f84b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de26fd09-23f9-48fc-b907-c234a2f84b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9abf20d-6c9e-4ed5-ad63-80f770d58dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9abf20d-6c9e-4ed5-ad63-80f770d58dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fba535c-6df1-48a7-9cdf-a52a61fa03a0', 'volume_name': 'volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0', 'volume_size': 1, 'snapshot_id': 'dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e64d73-f29a-4933-a547-a5860b9ba605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e64d73-f29a-4933-a547-a5860b9ba605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c432b7d-22f6-4b80-967a-b73c5d0409c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:30 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Volume 5fba535c-6df1-48a7-9cdf-a52a61fa03a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0', 'volume_size': 1, 'snapshot_id': 'dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d'} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Creating volume 5fba535c-6df1-48a7-9cdf-a52a61fa03a0 from snapshot dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] snapshot: dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d, volume: 5fba535c-6df1-48a7-9cdf-a52a61fa03a0, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7417d13e-b209-46ae-9a02-ff18c2a4d319]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:30 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:30 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:30 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.368s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ffa1de-5749-414b-8dfd-54c633450263]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:30 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:30 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:31 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:35:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:35:31 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:35:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:31 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 Nov 04 22:35:31 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:37 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" returned: 0 in 6.537s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:35:37 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Converted 1024.00 MB image at 156.61 MB/s Nov 04 22:35:37 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 is being set with open permissions: ugo+rw Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:37 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 Nov 04 22:35:37 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:37 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" returned: 0 in 0.235s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" released by "_copy_volume_from_snapshot" :: held 7.582s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" released by "_create_volume_from_snapshot" :: held 7.649s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.663s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c432b7d-22f6-4b80-967a-b73c5d0409c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0', 'volume_size': 1, 'snapshot_id': 'dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd39524-eeb7-4926-ab58-626fab554599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Volume volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 (5fba535c-6df1-48a7-9cdf-a52a61fa03a0): created successfully Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd39524-eeb7-4926-ab58-626fab554599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Flow 'volume_create_manager' (1552aff8-c970-479c-a3c4-dfc3cd66be4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9dbd3ccd-21b2-4526-9f29-287c3d842b94 tempest-VolumeDependencyTests-200517098 None] Created volume successfully. Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Deleting offline snapshot dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d of volume edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] snapshot_file for this snap is: volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba0919-1b8d-4e7f-94cd-1d795f12b5c1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:38 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:38 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:39 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.354s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[934754c0-3edf-4dde-b1ad-2d13bfd6e54e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:39 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:39 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:39 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.549s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:39 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:39 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:40 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:40 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d Nov 04 22:35:40 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:40 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076.dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=117,cinder:UPDATE=147,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=149,cinder:SELECT=104,cinder:INSERT=33,cinder:DELETE=19 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d" released by "_delete_snapshot" :: held 1.570s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" released by "delete_snapshot" :: held 1.595s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Created reservations ['db4c11b0-c2f7-4fa1-899a-3c0ab807b8d7', 'd66f8d57-1110-411b-9ec3-7c1e59afb503', '45c876ff-48b8-44e9-b7bc-1c94b696c32d', '6bfac2fa-dad6-421e-86fa-fd971c3b04e4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Delete snapshot completed successfully. Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9a6c9377-0e59-4e3e-b866-5749a2e338f7 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-dcc09397-fcf5-4d42-8d14-a5e9c46ffc9d-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d580a9-5aa3-413b-8253-38469673d1c5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:41 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:41 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:41 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:41 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076 Nov 04 22:35:41 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:41 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" returned: 0 in 0.260s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076" released by "delete_volume" :: held 0.675s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Created reservations ['77bb4eb4-daa1-4e3a-b8ec-4d70d197eb69', '7988675b-0fa8-4303-a606-5ca09e3c14e2', '6724a139-16df-44bd-9708-4ccbeca6a1c4', 'c83fe9ee-0df2-4dae-9240-822fd0261964'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:41 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:41 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:42 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Deleted volume successfully. Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-39009ebb-eb3f-41f1-8772-9f6157aae268 tempest-VolumeDependencyTests-200517098 None] Lock "cinder-edb03ef6-8d50-4bbd-9c3b-7b3b23da8076-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-5fba535c-6df1-48a7-9cdf-a52a61fa03a0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "cinder-5fba535c-6df1-48a7-9cdf-a52a61fa03a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Acquiring lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[627ce70c-0959-44ab-852d-ae3b55771141]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:42 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 Nov 04 22:35:42 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:42 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:42 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0 Nov 04 22:35:42 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:42 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "cinder-quobyte-5fba535c-6df1-48a7-9cdf-a52a61fa03a0" released by "delete_volume" :: held 0.679s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Created reservations ['6ea18c87-a272-4220-9d3c-7a607c6e315b', '33fd9298-9a8d-42f6-bfd1-fbfab61b747a', '0792c974-b826-495f-af44-60645cf2acab', '7310abab-de69-4b03-b44d-10f16b729dee'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:42 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:42 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:43 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:43 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Deleted volume successfully. Nov 04 22:35:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e031d1d0-511e-4dfa-a1a5-1be0ace39ede tempest-VolumeDependencyTests-200517098 None] Lock "cinder-5fba535c-6df1-48a7-9cdf-a52a61fa03a0-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Flow 'volume_create_manager' (e7158b94-9e87-4750-bca3-90624594dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc03a0-e21d-4165-8268-175c3fa47adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc03a0-e21d-4165-8268-175c3fa47adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0f986a-799b-4a57-b091-20248e31d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a409c3b94adf4b52a686e109c7b59ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:46Z,use_quota=True,user_id='1c851428041f440883e87af00b74711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9210b31a-17a9-414f-a438-73e46c4e9362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9210b31a-17a9-414f-a438-73e46c4e9362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b38110f-4d6c-4668-a2e0-b82dfa4dd04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b38110f-4d6c-4668-a2e0-b82dfa4dd04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0f986a-799b-4a57-b091-20248e31d10c', 'volume_name': 'volume-2a0f986a-799b-4a57-b091-20248e31d10c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f50fd4-b309-41af-b1f0-7464c96d48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f50fd4-b309-41af-b1f0-7464c96d48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60441687-0c33-415e-a2af-e6843a20dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Volume 2a0f986a-799b-4a57-b091-20248e31d10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0f986a-799b-4a57-b091-20248e31d10c', 'volume_size': 1} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0f986a-799b-4a57-b091-20248e31d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a409c3b94adf4b52a686e109c7b59ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:46Z,use_quota=True,user_id='1c851428041f440883e87af00b74711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Creating volume 2a0f986a-799b-4a57-b091-20248e31d10c {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:46 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:46 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c 1073741824 Nov 04 22:35:46 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:46 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c 1073741824" returned: 0 in 0.434s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:46 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c Nov 04 22:35:46 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:46 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60441687-0c33-415e-a2af-e6843a20dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0f986a-799b-4a57-b091-20248e31d10c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249c7c48-9a86-4144-9bc6-39d8ee3cb116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Volume volume-2a0f986a-799b-4a57-b091-20248e31d10c (2a0f986a-799b-4a57-b091-20248e31d10c): created successfully Nov 04 22:35:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249c7c48-9a86-4144-9bc6-39d8ee3cb116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Flow 'volume_create_manager' (e7158b94-9e87-4750-bca3-90624594dc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-79626806-80c5-4eec-8312-67d11dc0a297 tempest-CinderUnicodeTest-1275399164 None] Created volume successfully. Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Flow 'volume_create_manager' (24040189-5f71-4150-b918-73ca65025742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9549442e-37ee-416d-8141-983f1f1f1125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9549442e-37ee-416d-8141-983f1f1f1125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-364723990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a061bf-94ff-43a3-b9c2-dde259d3bf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a409c3b94adf4b52a686e109c7b59ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:48Z,use_quota=True,user_id='1c851428041f440883e87af00b74711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff5501-8a30-4d8e-9ff3-e225b2852601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff5501-8a30-4d8e-9ff3-e225b2852601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab9a4c-889b-464d-b120-59877f6cc886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab9a4c-889b-464d-b120-59877f6cc886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a061bf-94ff-43a3-b9c2-dde259d3bf83', 'volume_name': 'volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc0c8f9-452a-40ab-ab47-e61fa347280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc0c8f9-452a-40ab-ab47-e61fa347280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727f9a3-a0a4-4129-97bb-10e822592343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Volume 24a061bf-94ff-43a3-b9c2-dde259d3bf83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83', 'volume_size': 1} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:35:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-364723990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a061bf-94ff-43a3-b9c2-dde259d3bf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a409c3b94adf4b52a686e109c7b59ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:35:48Z,use_quota=True,user_id='1c851428041f440883e87af00b74711e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Creating volume 24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:35:47 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:35:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:47 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 1073741824 Nov 04 22:35:47 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:48 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 1073741824" returned: 0 in 0.666s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:48 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 Nov 04 22:35:48 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:48 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727f9a3-a0a4-4129-97bb-10e822592343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d2d314-e6ac-474b-a2a5-b8390504aeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:35:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Volume volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 (24a061bf-94ff-43a3-b9c2-dde259d3bf83): created successfully Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d2d314-e6ac-474b-a2a5-b8390504aeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:35:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Flow 'volume_create_manager' (24040189-5f71-4150-b918-73ca65025742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:35:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2fad7982-a43d-4fbe-8a97-00f932a90122 tempest-CinderUnicodeTest-1275399164 None] Created volume successfully. Nov 04 22:35:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-60818162-da93-465a-b813-00874660c209 req-29b54a42-5d68-4598-94d1-bc6bc74d8620 tempest-TestShelveInstance-1908422632 None] Terminate volume connection completed successfully. Nov 04 22:35:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [req-60818162-da93-465a-b813-00874660c209 req-29b54a42-5d68-4598-94d1-bc6bc74d8620 tempest-TestShelveInstance-1908422632 None] Deleting attachment eb907a0d-5d3d-499f-b5bb-0fa42d74fb19. {{(pid=87173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Acquiring lock "cinder-9c73c7ef-deaf-41ae-afb2-3a197751c657-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Creating offline snapshot 0a7312c6-c044-42c9-a81a-43876c65e187 of volume 24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "cinder-9c73c7ef-deaf-41ae-afb2-3a197751c657-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[be40f0a8-9117-40c3-b654-a2b43a094282]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Acquiring lock "cinder-quobyte-9c73c7ef-deaf-41ae-afb2-3a197751c657" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "cinder-quobyte-9c73c7ef-deaf-41ae-afb2-3a197751c657" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13a402-0ec6-424a-a41b-c6497dec3e22]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:50 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 Nov 04 22:35:50 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:50 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 Nov 04 22:35:50 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:50 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83" returned: 0 in 0.462s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:50 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 1G Nov 04 22:35:50 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:50 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657" returned: 0 in 0.526s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:50 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657 Nov 04 22:35:50 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:51 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9c73c7ef-deaf-41ae-afb2-3a197751c657" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:51 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 1G" returned: 0 in 0.431s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "cinder-quobyte-9c73c7ef-deaf-41ae-afb2-3a197751c657" released by "delete_volume" :: held 0.863s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:51 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 Nov 04 22:35:51 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.quota [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Created reservations ['ac44a47d-2400-46f4-95c7-37f93c182bf4', '35e9b29e-04be-4c85-9484-318cdfd1dc34', 'df8f44bd-8aca-4a58-9ae5-e53a0b5b8302', '7e388255-499c-48ab-a718-53d74683f45e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:51 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:51 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:51 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187" returned: 0 in 0.311s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:51 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 is being set with open permissions: ugo+rw Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:51 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 Nov 04 22:35:51 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:51 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.265s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.manager [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Deleted volume successfully. Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [req-60818162-da93-465a-b813-00874660c209 req-d0f740fe-06be-45ba-8038-844f6cc66b49 tempest-TestShelveInstance-1908422632 None] Lock "cinder-9c73c7ef-deaf-41ae-afb2-3a197751c657-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:51 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:51 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info Nov 04 22:35:51 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:52 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info" returned: 0 in 0.285s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:52 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info is being set with open permissions: ugo+rw Nov 04 22:35:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:52 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info Nov 04 22:35:52 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:52 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.info" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f6ce3cb3-39c2-45f3-8b1a-fa7c8b1111cc tempest-CinderUnicodeTest-1275399164 None] Create snapshot completed successfully Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-0a7312c6-c044-42c9-a81a-43876c65e187-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-0a7312c6-c044-42c9-a81a-43876c65e187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-quobyte-0a7312c6-c044-42c9-a81a-43876c65e187" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-0a7312c6-c044-42c9-a81a-43876c65e187" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Deleting offline snapshot 0a7312c6-c044-42c9-a81a-43876c65e187 of volume 24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] snapshot_file for this snap is: volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a02d6-cd91-44e2-a0d2-e7df7ab87bcb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:53 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 Nov 04 22:35:53 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:53 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b6a58-d23e-40f0-818f-767a0d2ab198]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:54 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 Nov 04 22:35:54 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:54 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83" returned: 0 in 0.371s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:54 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 Nov 04 22:35:54 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:54 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187" returned: 0 in 0.373s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:54 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187 Nov 04 22:35:54 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:54 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83.0a7312c6-c044-42c9-a81a-43876c65e187" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-0a7312c6-c044-42c9-a81a-43876c65e187" released by "_delete_snapshot" :: held 1.540s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" released by "delete_snapshot" :: held 1.566s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Created reservations ['400bc221-b98c-4e75-9267-9adf1d60ce03', 'e2cfd3b2-70ca-481f-8930-fe90d85b572e', 'a8a9fd29-6fcc-4201-b64c-816f03b1b9fe', '6f1db5f3-4f02-44b9-9f74-3547436c7422'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Delete snapshot completed successfully. Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-443ab6aa-fd69-41cb-bb83-badc3872dff1 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-0a7312c6-c044-42c9-a81a-43876c65e187-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-24a061bf-94ff-43a3-b9c2-dde259d3bf83-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-24a061bf-94ff-43a3-b9c2-dde259d3bf83-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6692e8c9-49a8-49db-87df-1be0b218a678]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:55 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 Nov 04 22:35:55 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:56 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:56 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83 Nov 04 22:35:56 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:56 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-24a061bf-94ff-43a3-b9c2-dde259d3bf83" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-24a061bf-94ff-43a3-b9c2-dde259d3bf83" released by "delete_volume" :: held 0.753s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Created reservations ['6484d9a4-ab21-4a25-b34c-1b5e0f9cecd9', 'ed652a87-82e1-4fd1-9367-2f2349344a7b', '0858634d-a399-462a-ac26-c26049ce201b', '51401adf-5d6d-4391-9e60-4bf4166f4a81'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:56 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:56 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:56 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:56 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-2a0f986a-799b-4a57-b091-20248e31d10c-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:56 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-2a0f986a-799b-4a57-b091-20248e31d10c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Deleted volume successfully. Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-75786b39-f89f-4f89-8cc7-fdcd49b132a4 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-24a061bf-94ff-43a3-b9c2-dde259d3bf83-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "cinder-quobyte-2a0f986a-799b-4a57-b091-20248e31d10c" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-2a0f986a-799b-4a57-b091-20248e31d10c" acquired by "delete_volume" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc4d8a-871c-4232-bb68-2342a9d01a66]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:35:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:56 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:35:57 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c Nov 04 22:35:57 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:57 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c" returned: 0 in 0.439s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:57 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c Nov 04 22:35:57 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:57 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a0f986a-799b-4a57-b091-20248e31d10c" returned: 0 in 0.268s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-quobyte-2a0f986a-799b-4a57-b091-20248e31d10c" released by "delete_volume" :: held 0.756s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Created reservations ['c6a96526-8242-4417-a0df-00e52cba9e2e', 'cd0b4f8a-657b-4354-bfeb-3e547b48de72', '34955e7c-90a5-4f6a-a20f-5256f2ecbcee', '14b181c9-6423-4c37-b417-cc3f2946c2b6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:35:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:35:57 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:35:57 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:35:58 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 04 22:35:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.300s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:35:58 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:35:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Deleted volume successfully. Nov 04 22:35:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5596307c-d0d1-4fbb-b1ca-f8ace12687d3 tempest-CinderUnicodeTest-1275399164 None] Lock "cinder-2a0f986a-799b-4a57-b091-20248e31d10c-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (52832a39-c363-4f7f-b212-dad2ff9d614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e4bda-0516-4e96-b56f-c1a520de858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e4bda-0516-4e96-b56f-c1a520de858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980121481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b034a09-9368-455a-adc6-8386b7a807fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:07Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884dcf32-3297-4d23-8487-3188d24dd2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884dcf32-3297-4d23-8487-3188d24dd2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea82853e-519d-4327-a54d-f6b3c4a23043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea82853e-519d-4327-a54d-f6b3c4a23043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b034a09-9368-455a-adc6-8386b7a807fd', 'volume_name': 'volume-7b034a09-9368-455a-adc6-8386b7a807fd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d96b89-c5b8-47e4-98d6-906f6627922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d96b89-c5b8-47e4-98d6-906f6627922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd74bb-21b3-4589-a652-281479065fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Volume 7b034a09-9368-455a-adc6-8386b7a807fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b034a09-9368-455a-adc6-8386b7a807fd', 'volume_size': 1} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980121481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b034a09-9368-455a-adc6-8386b7a807fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:07Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Creating volume 7b034a09-9368-455a-adc6-8386b7a807fd {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:36:06 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:36:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:06 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd 1073741824 Nov 04 22:36:06 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:07 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd 1073741824" returned: 0 in 0.467s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:07 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd Nov 04 22:36:07 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:07 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd" returned: 0 in 0.269s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd74bb-21b3-4589-a652-281479065fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b034a09-9368-455a-adc6-8386b7a807fd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a5e312-5396-42ec-9ca5-1a630413bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Volume volume-7b034a09-9368-455a-adc6-8386b7a807fd (7b034a09-9368-455a-adc6-8386b7a807fd): created successfully Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a5e312-5396-42ec-9ca5-1a630413bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (52832a39-c363-4f7f-b212-dad2ff9d614e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c30d2ecf-f693-4c41-8b00-92f7de1b07ae tempest-ProjectReaderTests-1003276905 None] Created volume successfully. Nov 04 22:36:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-7b034a09-9368-455a-adc6-8386b7a807fd-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "cinder-7b034a09-9368-455a-adc6-8386b7a807fd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-quobyte-7b034a09-9368-455a-adc6-8386b7a807fd" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-7b034a09-9368-455a-adc6-8386b7a807fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[884944e8-ca91-4f30-aed2-6a3f3c240ec2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:09 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd Nov 04 22:36:09 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:09 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd" returned: 0 in 0.447s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:09 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd Nov 04 22:36:09 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:09 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7b034a09-9368-455a-adc6-8386b7a807fd" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-7b034a09-9368-455a-adc6-8386b7a807fd" released by "delete_volume" :: held 0.752s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Created reservations ['c38733b9-a3a3-4bed-aded-d6d78712386d', 'f205fc46-416b-4180-955d-5bb19c001d9a', '57f19540-0754-4f8f-937b-b78bba7a3784', 'e0225897-7bb5-4703-bd8e-f84531a93dc4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:09 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:09 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:10 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Deleted volume successfully. Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-34810a35-c243-40b9-9572-0928f4048af8 tempest-ProjectReaderTests-1003276905 None] Lock "cinder-7b034a09-9368-455a-adc6-8386b7a807fd-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (4cc2455b-afd8-46d4-9828-109ab97dcb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53180fce-f733-407e-9964-3049280fdc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53180fce-f733-407e-9964-3049280fdc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290143237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e1410-2671-4638-8417-eff9b1e868fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:11Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddf754-a52a-402c-93b5-478c6bfda4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddf754-a52a-402c-93b5-478c6bfda4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeda01-854c-418b-84b2-d49693e9aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeda01-854c-418b-84b2-d49693e9aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4e1410-2671-4638-8417-eff9b1e868fb', 'volume_name': 'volume-9d4e1410-2671-4638-8417-eff9b1e868fb', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1cf843-9290-40bd-8e47-84e0eaf025db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1cf843-9290-40bd-8e47-84e0eaf025db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be31a24d-d7f1-47ee-af4e-542f8e151982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Volume 9d4e1410-2671-4638-8417-eff9b1e868fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4e1410-2671-4638-8417-eff9b1e868fb', 'volume_size': 1} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290143237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e1410-2671-4638-8417-eff9b1e868fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:11Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Creating volume 9d4e1410-2671-4638-8417-eff9b1e868fb {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:36:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:36:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:10 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb 1073741824 Nov 04 22:36:10 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:11 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb 1073741824" returned: 0 in 0.474s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:11 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb Nov 04 22:36:11 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:11 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be31a24d-d7f1-47ee-af4e-542f8e151982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4e1410-2671-4638-8417-eff9b1e868fb', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0517a4-bef5-46f8-8187-5842347abe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Volume volume-9d4e1410-2671-4638-8417-eff9b1e868fb (9d4e1410-2671-4638-8417-eff9b1e868fb): created successfully Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0517a4-bef5-46f8-8187-5842347abe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (4cc2455b-afd8-46d4-9828-109ab97dcb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0fdd94b0-8645-40f8-8c51-935eeaf721af tempest-ProjectReaderTests-1003276905 None] Created volume successfully. Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-9d4e1410-2671-4638-8417-eff9b1e868fb-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-9d4e1410-2671-4638-8417-eff9b1e868fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-quobyte-9d4e1410-2671-4638-8417-eff9b1e868fb" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-9d4e1410-2671-4638-8417-eff9b1e868fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fd22f6-70d6-4407-8551-1c63c41c5c7f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:12 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb Nov 04 22:36:12 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:13 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:13 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb Nov 04 22:36:13 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:13 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9d4e1410-2671-4638-8417-eff9b1e868fb" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-9d4e1410-2671-4638-8417-eff9b1e868fb" released by "delete_volume" :: held 0.738s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Created reservations ['586e836b-53f8-412c-af3c-2807041c52a4', '72eddd4e-f2af-4583-8d01-1b8d619e87fb', '473e472a-18d3-4406-a60f-77685b526634', '6dc73513-098f-4a6f-9a9a-ef684dd26768'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:13 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:13 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:13 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.304s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Deleted volume successfully. Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3e417d81-d467-444f-8d8e-e5fb7bcb515b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-9d4e1410-2671-4638-8417-eff9b1e868fb-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (3e19898a-3bfe-44af-bee7-b909da08ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80622bc9-0676-4b97-95ed-9d3c9bec3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80622bc9-0676-4b97-95ed-9d3c9bec3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417250089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbc28d-55b3-4a67-8f2a-6e645da0c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:15Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d5e798-7131-4537-8a84-1113a29b0364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d5e798-7131-4537-8a84-1113a29b0364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa43ea15-71ff-415f-8039-10ada576a0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa43ea15-71ff-415f-8039-10ada576a0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cbc28d-55b3-4a67-8f2a-6e645da0c47f', 'volume_name': 'volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40551947-163c-4177-ab63-118ff0a5331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40551947-163c-4177-ab63-118ff0a5331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9660231a-755d-4d46-9d5a-7351447e87ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:14 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Volume 05cbc28d-55b3-4a67-8f2a-6e645da0c47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f', 'volume_size': 1} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417250089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbc28d-55b3-4a67-8f2a-6e645da0c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:15Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Creating volume 05cbc28d-55b3-4a67-8f2a-6e645da0c47f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:36:14 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:36:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:14 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f 1073741824 Nov 04 22:36:14 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:15 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f 1073741824" returned: 0 in 0.432s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:15 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f Nov 04 22:36:15 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:15 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9660231a-755d-4d46-9d5a-7351447e87ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb847e6e-2d3d-4a0d-8460-f4c9c58eaa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:15 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Volume volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f (05cbc28d-55b3-4a67-8f2a-6e645da0c47f): created successfully Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb847e6e-2d3d-4a0d-8460-f4c9c58eaa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:15 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (3e19898a-3bfe-44af-bee7-b909da08ffac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:15 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-51c9b846-cec3-46e7-b2ac-6b2736105d2c tempest-ProjectReaderTests-1003276905 None] Created volume successfully. Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-05cbc28d-55b3-4a67-8f2a-6e645da0c47f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "cinder-05cbc28d-55b3-4a67-8f2a-6e645da0c47f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-quobyte-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[309cff0a-0393-42c3-ad51-4460b8f03bd8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:16 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f Nov 04 22:36:16 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:17 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:17 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f Nov 04 22:36:17 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:17 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-05cbc28d-55b3-4a67-8f2a-6e645da0c47f" released by "delete_volume" :: held 0.701s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Created reservations ['fcd76186-1efb-4867-b60d-50df353898c2', 'e2140d8b-67cf-4e76-8581-b5efde21096e', '85d7f523-c477-40bc-a3b8-74ba36d8afc5', 'bc305736-46e2-4c68-8856-d9c3b88ba65d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:17 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:17 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:17 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Deleted volume successfully. Nov 04 22:36:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e866b091-ee07-42a5-996e-24f43ac7982e tempest-ProjectReaderTests-1003276905 None] Lock "cinder-05cbc28d-55b3-4a67-8f2a-6e645da0c47f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (f0c96db8-8f15-411a-a1d3-6ca58b3a9411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521cffcd-0a7e-425d-a2ff-4d0477413054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521cffcd-0a7e-425d-a2ff-4d0477413054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557414580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9221d4ca-286d-4b3e-bc5f-d77582179ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:18Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b78bad3-f866-4c6b-a6ac-a00c3151a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b78bad3-f866-4c6b-a6ac-a00c3151a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631ee60a-48f2-40bb-b86a-593a9fae9a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631ee60a-48f2-40bb-b86a-593a9fae9a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9221d4ca-286d-4b3e-bc5f-d77582179ff2', 'volume_name': 'volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b58231-b45a-48d4-9e7a-13cbda937daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b58231-b45a-48d4-9e7a-13cbda937daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543721da-2123-4c3f-b792-f2c3b10c8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:18 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Volume 9221d4ca-286d-4b3e-bc5f-d77582179ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2', 'volume_size': 1} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557414580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9221d4ca-286d-4b3e-bc5f-d77582179ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d058fe3a0d484b5b9add1c7cde57b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:18Z,use_quota=True,user_id='a3939e28d16443b2983af1add2b1ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Creating volume 9221d4ca-286d-4b3e-bc5f-d77582179ff2 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:36:18 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:18 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 1073741824 Nov 04 22:36:18 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:18 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 1073741824" returned: 0 in 0.489s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:18 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 Nov 04 22:36:18 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:19 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2" returned: 0 in 0.242s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543721da-2123-4c3f-b792-f2c3b10c8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02aba04c-8e66-4c06-b9d2-263b6467ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:19 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Volume volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 (9221d4ca-286d-4b3e-bc5f-d77582179ff2): created successfully Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02aba04c-8e66-4c06-b9d2-263b6467ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:19 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Flow 'volume_create_manager' (f0c96db8-8f15-411a-a1d3-6ca58b3a9411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-50173f4f-3536-4ab5-8083-e8e1528673a4 tempest-ProjectReaderTests-1003276905 None] Created volume successfully. Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-9221d4ca-286d-4b3e-bc5f-d77582179ff2-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-9221d4ca-286d-4b3e-bc5f-d77582179ff2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "cinder-quobyte-9221d4ca-286d-4b3e-bc5f-d77582179ff2" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-9221d4ca-286d-4b3e-bc5f-d77582179ff2" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8559b0-5492-4717-843e-e5d9cc53a695]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:20 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 Nov 04 22:36:20 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:20 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:20 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2 Nov 04 22:36:20 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:21 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9221d4ca-286d-4b3e-bc5f-d77582179ff2" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-quobyte-9221d4ca-286d-4b3e-bc5f-d77582179ff2" released by "delete_volume" :: held 0.724s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Created reservations ['8c4764b0-8aff-4420-b376-06577e450f60', '58ac2e0a-0d78-41a8-84a4-b76ab732b94e', 'a3829413-d07d-49ae-a872-2fcfe8e0ce29', '2adaec32-56b3-4517-bdd2-e514b1e90e36'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:21 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:21 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:21 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Deleted volume successfully. Nov 04 22:36:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-380b3a35-cbb8-40d7-abd8-713b170d2b9b tempest-ProjectReaderTests-1003276905 None] Lock "cinder-9221d4ca-286d-4b3e-bc5f-d77582179ff2-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Flow 'volume_create_manager' (6cc49a92-dc13-4d93-b8d3-dec70fe00d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b72fb-a80b-4f6b-9607-8b8e6206a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b72fb-a80b-4f6b-9607-8b8e6206a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1059593681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4c0a70-c78f-45fa-9d04-bc07bf8824b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1921d99051244538afa1f9ed136b224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:27Z,use_quota=True,user_id='57a1fd43790a47fa90824917ee9d7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13890ea1-4c60-48dd-b5d6-20ca9d64cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13890ea1-4c60-48dd-b5d6-20ca9d64cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754958d0-aea1-425c-94fa-c6a314c4e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754958d0-aea1-425c-94fa-c6a314c4e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4c0a70-c78f-45fa-9d04-bc07bf8824b8', 'volume_name': 'volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e077e-e5b9-4ab7-83de-9997d31b71a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e077e-e5b9-4ab7-83de-9997d31b71a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90659ab2-06b2-4d9d-9deb-d513854ce7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:27 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Volume ef4c0a70-c78f-45fa-9d04-bc07bf8824b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8', 'volume_size': 1} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1059593681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4c0a70-c78f-45fa-9d04-bc07bf8824b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1921d99051244538afa1f9ed136b224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:36:27Z,use_quota=True,user_id='57a1fd43790a47fa90824917ee9d7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Creating volume ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:36:27 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:27 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 1073741824 Nov 04 22:36:27 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:27 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 1073741824" returned: 0 in 0.411s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:27 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:27 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:28 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90659ab2-06b2-4d9d-9deb-d513854ce7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c4ff0-09d5-406c-b70d-c25a19674d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:36:28 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Volume volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 (ef4c0a70-c78f-45fa-9d04-bc07bf8824b8): created successfully Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c4ff0-09d5-406c-b70d-c25a19674d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:36:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Flow 'volume_create_manager' (6cc49a92-dc13-4d93-b8d3-dec70fe00d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:36:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-583a6bde-a27e-46fe-8969-6b77e6ae68d0 tempest-TestImageHashVerification-1565203477 None] Created volume successfully. Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0435b0f-3eec-452e-96db-ef9587394add]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:29 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:29 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:29 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.358s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c586b72-12ee-49a5-9f7a-afb39e1c25ab]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:29 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:29 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:29 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.351s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 /opt/stack/data/cinder/conversion/ef4c0a70-c78f-45fa-9d04-bc07bf8824b8.temp_image.3fc8c186-04aa-4345-90e0-57442de574434i96qao9.img {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:29 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 /opt/stack/data/cinder/conversion/ef4c0a70-c78f-45fa-9d04-bc07bf8824b8.temp_image.3fc8c186-04aa-4345-90e0-57442de574434i96qao9.img Nov 04 22:36:29 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:35 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 /opt/stack/data/cinder/conversion/ef4c0a70-c78f-45fa-9d04-bc07bf8824b8.temp_image.3fc8c186-04aa-4345-90e0-57442de574434i96qao9.img" returned: 0 in 6.073s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:35 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[0590421f-167b-4d39-9c7b-b4ed96744a9c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:36 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:36 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:36 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.524s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:36 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/conversion/ef4c0a70-c78f-45fa-9d04-bc07bf8824b8.temp_image.3fc8c186-04aa-4345-90e0-57442de574434i96qao9.img {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:36:36 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Converted 1024.00 MB image at 168.58 MB/s Nov 04 22:36:36 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] 3fc8c186-04aa-4345-90e0-57442de57443 was raw, no need to convert to raw {{(pid=87173) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 22:36:46 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=70,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=12 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:36:46 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=81,cinder:INSERT=22,cinder:UPDATE=112,cinder:DELETE=5 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:36:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.123s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Uploaded volume to glance image-id: 3fc8c186-04aa-4345-90e0-57442de57443. {{(pid=87173) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 22:36:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2b563bb5-133d-442e-8f9b-97ccc9e71130 tempest-TestImageHashVerification-1565203477 None] Copy volume to image completed successfully. Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Acquiring lock "cinder-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "cinder-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Acquiring lock "cinder-quobyte-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "cinder-quobyte-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba4d040-6eee-4047-b1d9-27e435f9ebd5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:36:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:55 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:55 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:55 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:56 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8 Nov 04 22:36:56 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:56 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" returned: 0 in 0.245s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "cinder-quobyte-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8" released by "delete_volume" :: held 0.642s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Created reservations ['25714bff-d57d-41af-816c-a5a87a2ce9f3', '631fb8ce-4329-4708-a0bf-3855c06dfd7a', '7efbe9c7-5dd7-4039-b3e3-84801766fe2c', '414cd11d-f082-4c6e-b425-cff754c9bb23'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:56 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:56 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:56 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.242s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Deleted volume successfully. Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:36:56 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:36:56 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-badddc89-6c40-4099-912a-9d1a3c7c3c8e tempest-TestImageHashVerification-1565203477 None] Lock "cinder-ef4c0a70-c78f-45fa-9d04-bc07bf8824b8-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:36:56 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.262s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:36:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:37:06 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:37:06 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (048668a2-34ce-4582-b570-01836824c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064991ff-ed4b-4e19-bd44-30465bb4b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064991ff-ed4b-4e19-bd44-30465bb4b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da71268-d221-4484-bf23-055b698b4636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a822c1-eb8e-4966-a19b-2a3ad9e31431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a822c1-eb8e-4966-a19b-2a3ad9e31431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d583ec3-a244-4448-8a9b-57a4a5bbd63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d583ec3-a244-4448-8a9b-57a4a5bbd63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da71268-d221-4484-bf23-055b698b4636', 'volume_name': 'volume-9da71268-d221-4484-bf23-055b698b4636', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c14a04-6d33-416b-8fe0-7c21edf3ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c14a04-6d33-416b-8fe0-7c21edf3ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40437c88-bf2f-417c-b668-eddf2fbb2dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:07 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Volume 9da71268-d221-4484-bf23-055b698b4636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da71268-d221-4484-bf23-055b698b4636', 'volume_size': 1} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da71268-d221-4484-bf23-055b698b4636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Creating volume 9da71268-d221-4484-bf23-055b698b4636 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:07 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:07 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 1073741824 Nov 04 22:37:07 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:07 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (05d2d2f0-ebed-447e-81fa-157c3994c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d262f34-ec8f-4d0c-aa1d-250576acb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d262f34-ec8f-4d0c-aa1d-250576acb979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752397887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454df7eb-4d14-44db-9a32-11a717a35d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef70d67-2f91-4880-9cff-7a74cf8fadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef70d67-2f91-4880-9cff-7a74cf8fadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11342b0c-a5de-4559-84db-b168510b97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11342b0c-a5de-4559-84db-b168510b97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454df7eb-4d14-44db-9a32-11a717a35d51', 'volume_name': 'volume-454df7eb-4d14-44db-9a32-11a717a35d51', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72316ebe-1486-4585-92d3-4c5316980a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72316ebe-1486-4585-92d3-4c5316980a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1906033c-ac8c-498b-b557-f35e08d92010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Volume 454df7eb-4d14-44db-9a32-11a717a35d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454df7eb-4d14-44db-9a32-11a717a35d51', 'volume_size': 1} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:08 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 1073741824" returned: 0 in 0.508s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:08 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 Nov 04 22:37:08 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (205b5a4e-739f-4c1f-ac28-c6ec2264ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3c2366-7867-470c-babe-164aa404d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3c2366-7867-470c-babe-164aa404d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140631104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a398f69-6b0c-4c14-9bea-ad241fa8c83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab24b49-4e00-41ad-98f5-0a1ff2704676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab24b49-4e00-41ad-98f5-0a1ff2704676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f442c1-98c4-4db5-9f22-c975ab422e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f442c1-98c4-4db5-9f22-c975ab422e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a398f69-6b0c-4c14-9bea-ad241fa8c83b', 'volume_name': 'volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031d942d-182b-4e9c-987b-521788a9cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031d942d-182b-4e9c-987b-521788a9cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d4cc31-0fb7-4c20-999e-57782fba890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Volume 2a398f69-6b0c-4c14-9bea-ad241fa8c83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b', 'volume_size': 1} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:08 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752397887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454df7eb-4d14-44db-9a32-11a717a35d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Creating volume 454df7eb-4d14-44db-9a32-11a717a35d51 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:08 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 1073741824 Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40437c88-bf2f-417c-b668-eddf2fbb2dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da71268-d221-4484-bf23-055b698b4636', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527e83cd-42c1-4262-ba84-e8d0a253eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Volume volume-9da71268-d221-4484-bf23-055b698b4636 (9da71268-d221-4484-bf23-055b698b4636): created successfully Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527e83cd-42c1-4262-ba84-e8d0a253eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (048668a2-34ce-4582-b570-01836824c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-270e51cb-96c6-4463-a45c-df03f5346fc4 tempest-CreateVolumesFromImageTest-750306572 None] Created volume successfully. Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (ef3adaaa-962f-4225-bb8b-01c2302db839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e77a5f-d804-404d-8cc3-329aa3e89b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e77a5f-d804-404d-8cc3-329aa3e89b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278554878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65610c-43d7-40a5-a9ef-af3b136f26a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:09Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d735a39b-6664-4b3d-a635-2e14a7c78a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d735a39b-6664-4b3d-a635-2e14a7c78a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff25973c-927f-48d6-b04a-5e7c2c535705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff25973c-927f-48d6-b04a-5e7c2c535705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c65610c-43d7-40a5-a9ef-af3b136f26a5', 'volume_name': 'volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11370b-7f62-40a4-8104-8ad4f4c09640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11370b-7f62-40a4-8104-8ad4f4c09640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaa42c2-ecc2-4521-a8fb-929cfec0d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Volume 0c65610c-43d7-40a5-a9ef-af3b136f26a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5', 'volume_size': 1} Nov 04 22:37:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:09 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 1073741824" returned: 0 in 0.491s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:09 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 Nov 04 22:37:09 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (4381f2b9-c91c-444f-8026-b0f03e0abd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65131096-4dc2-4066-8198-4d80355e1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65131096-4dc2-4066-8198-4d80355e1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409598783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b58467-c0a9-4a6e-894f-54cbeaf653b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:09Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd6326b-7e86-47cf-8a57-f0024c575b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd6326b-7e86-47cf-8a57-f0024c575b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afef2917-625a-4be7-881b-4517f4b214db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afef2917-625a-4be7-881b-4517f4b214db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b58467-c0a9-4a6e-894f-54cbeaf653b9', 'volume_name': 'volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787a112-468d-483e-9af9-66018527d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787a112-468d-483e-9af9-66018527d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9064ea-78fc-4d26-8eaa-d98c9d29c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Volume c5b58467-c0a9-4a6e-894f-54cbeaf653b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9', 'volume_size': 1} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:09 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140631104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a398f69-6b0c-4c14-9bea-ad241fa8c83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:08Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Creating volume 2a398f69-6b0c-4c14-9bea-ad241fa8c83b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:09 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1906033c-ac8c-498b-b557-f35e08d92010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454df7eb-4d14-44db-9a32-11a717a35d51', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b 1073741824 Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df1c61-f0aa-4d5f-bd11-1e3097e640a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:09 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Volume volume-454df7eb-4d14-44db-9a32-11a717a35d51 (454df7eb-4d14-44db-9a32-11a717a35d51): created successfully Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df1c61-f0aa-4d5f-bd11-1e3097e640a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (05d2d2f0-ebed-447e-81fa-157c3994c215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-54fb98a0-d576-4c6f-8531-0ca2a4c1d8e8 tempest-CreateVolumesFromImageTest-750306572 None] Created volume successfully. Nov 04 22:37:09 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b 1073741824" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:09 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b Nov 04 22:37:09 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:10 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" returned: 0 in 0.234s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278554878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65610c-43d7-40a5-a9ef-af3b136f26a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:09Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Creating volume 0c65610c-43d7-40a5-a9ef-af3b136f26a5 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d4cc31-0fb7-4c20-999e-57782fba890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:10 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 1073741824 Nov 04 22:37:10 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8b6d5-0a99-4413-a0d0-afc8221ebd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Volume volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b (2a398f69-6b0c-4c14-9bea-ad241fa8c83b): created successfully Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8b6d5-0a99-4413-a0d0-afc8221ebd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (205b5a4e-739f-4c1f-ac28-c6ec2264ce09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-51201875-3cf6-40f7-81a9-5d684a3f2853 tempest-CreateVolumesFromImageTest-750306572 None] Created volume successfully. Nov 04 22:37:10 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 1073741824" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:10 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 Nov 04 22:37:10 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:10 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409598783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b58467-c0a9-4a6e-894f-54cbeaf653b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27fbec11ca24b71af738eece010f6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:09Z,use_quota=True,user_id='a367dae9363b4acebfea6228bc8af75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Creating volume c5b58467-c0a9-4a6e-894f-54cbeaf653b9 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaa42c2-ecc2-4521-a8fb-929cfec0d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:10 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 1073741824 Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b2156-36b0-4013-bb98-771f6b1b9004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:10 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Volume volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 (0c65610c-43d7-40a5-a9ef-af3b136f26a5): created successfully Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b2156-36b0-4013-bb98-771f6b1b9004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (ef3adaaa-962f-4225-bb8b-01c2302db839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-75a9c1bf-d8ae-43c4-9b66-2cb3af4860ee tempest-CreateVolumesFromImageTest-750306572 None] Created volume successfully. Nov 04 22:37:11 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 1073741824" returned: 0 in 0.409s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:11 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 Nov 04 22:37:11 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:11 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" returned: 0 in 0.243s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9064ea-78fc-4d26-8eaa-d98c9d29c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc00b88-35f5-4e3f-9800-75ede1164841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Volume volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 (c5b58467-c0a9-4a6e-894f-54cbeaf653b9): created successfully Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc00b88-35f5-4e3f-9800-75ede1164841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Flow 'volume_create_manager' (4381f2b9-c91c-444f-8026-b0f03e0abd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d3c855a5-c014-4e69-bcd7-bd67198682ce tempest-CreateVolumesFromImageTest-750306572 None] Created volume successfully. Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-c5b58467-c0a9-4a6e-894f-54cbeaf653b9-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-c5b58467-c0a9-4a6e-894f-54cbeaf653b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-quobyte-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529e010-1239-47e3-88db-49a32f5708ac]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:12 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 Nov 04 22:37:12 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:13 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:13 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9 Nov 04 22:37:13 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:13 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-c5b58467-c0a9-4a6e-894f-54cbeaf653b9" released by "delete_volume" :: held 0.638s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Created reservations ['7b22f960-9324-4bf2-9948-26c45a76b49f', '164748f4-d886-46fc-a4d5-8c6a0ef156b7', 'cdc0ce89-e804-4933-9f09-d960d50d3c58', '7040ef9e-cba4-4a84-a258-6ca92a0eadd6'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:13 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:13 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:13 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Deleted volume successfully. Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-164a460d-94bc-491d-afed-d181e455cb48 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-c5b58467-c0a9-4a6e-894f-54cbeaf653b9-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-0c65610c-43d7-40a5-a9ef-af3b136f26a5-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-0c65610c-43d7-40a5-a9ef-af3b136f26a5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-quobyte-0c65610c-43d7-40a5-a9ef-af3b136f26a5" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-0c65610c-43d7-40a5-a9ef-af3b136f26a5" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b55d21-3354-4ed8-a330-c87e86d995d0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:14 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 Nov 04 22:37:14 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:14 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5" returned: 0 in 0.362s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:14 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5 Nov 04 22:37:14 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:14 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0c65610c-43d7-40a5-a9ef-af3b136f26a5" returned: 0 in 0.242s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-0c65610c-43d7-40a5-a9ef-af3b136f26a5" released by "delete_volume" :: held 0.654s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Created reservations ['5b38ab6e-dcb2-4246-a323-d8f39468e1d5', '8d918fee-a9d6-4df7-8245-627a4a5ebc99', 'c6f703b0-58d3-4c38-9876-2af027cb5011', '2bb0ea32-eed9-47a2-9e20-7946d9b88b2d'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:14 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:14 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:14 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Deleted volume successfully. Nov 04 22:37:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5786da63-d9f4-4f94-ae6c-a6d245cd7088 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-0c65610c-43d7-40a5-a9ef-af3b136f26a5-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-2a398f69-6b0c-4c14-9bea-ad241fa8c83b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-2a398f69-6b0c-4c14-9bea-ad241fa8c83b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-quobyte-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d63b6e-57a3-4f06-8b6a-bad5637edacb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:15 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b Nov 04 22:37:15 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:15 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" returned: 0 in 0.352s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:15 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b Nov 04 22:37:15 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:15 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-2a398f69-6b0c-4c14-9bea-ad241fa8c83b" released by "delete_volume" :: held 0.652s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Created reservations ['6c98b804-4c9d-4db4-84e8-18916219be7b', '2130c55f-0adb-4f55-a160-747dda3d1531', '78b4f968-6bed-4afe-9c16-f6b970026cfe', '6415e6fe-3931-4ead-8940-289f6ee05fbb'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:15 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:15 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:16 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Deleted volume successfully. Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1e49e30a-c986-46a4-abd9-d5b9f415421e tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-2a398f69-6b0c-4c14-9bea-ad241fa8c83b-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-454df7eb-4d14-44db-9a32-11a717a35d51-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-454df7eb-4d14-44db-9a32-11a717a35d51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-quobyte-454df7eb-4d14-44db-9a32-11a717a35d51" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-454df7eb-4d14-44db-9a32-11a717a35d51" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8074afb-eccd-4a78-94c0-857158cfe516]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:16 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 Nov 04 22:37:16 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:16 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51" returned: 0 in 0.367s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:16 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51 Nov 04 22:37:16 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:16 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-454df7eb-4d14-44db-9a32-11a717a35d51" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-454df7eb-4d14-44db-9a32-11a717a35d51" released by "delete_volume" :: held 0.655s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:16 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Created reservations ['c5b7a59b-717a-491e-beec-1e8e18280176', '392dba4f-62f6-40f8-b96e-57c1252e173c', '050f6332-2d71-48c3-b327-07e30a15c328', 'b3959fd3-c3e3-481c-addd-433c7f7b9d2f'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:17 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:17 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:17 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Deleted volume successfully. Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189e34e-5a4a-4bea-8bca-6d3421930e6f tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-454df7eb-4d14-44db-9a32-11a717a35d51-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-9da71268-d221-4484-bf23-055b698b4636-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-9da71268-d221-4484-bf23-055b698b4636-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "cinder-quobyte-9da71268-d221-4484-bf23-055b698b4636" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-9da71268-d221-4484-bf23-055b698b4636" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b96c4be-e5c7-4beb-aaa7-428c8202f575]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:17 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 Nov 04 22:37:17 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:17 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636" returned: 0 in 0.358s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:17 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636 Nov 04 22:37:17 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:18 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9da71268-d221-4484-bf23-055b698b4636" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-quobyte-9da71268-d221-4484-bf23-055b698b4636" released by "delete_volume" :: held 0.638s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Created reservations ['e3f23902-f190-4776-80b9-7539f2c96879', 'dedfd575-ac7c-459f-bcb4-326076d75289', '98b9b351-130b-45bf-b41d-16758875ce2f', '0aadc75d-9160-4d4b-b481-ce1b5262064a'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:18 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:18 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:18 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.244s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:18 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Deleted volume successfully. Nov 04 22:37:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4790e5b9-dd0f-4d51-8064-e437b88baab8 tempest-CreateVolumesFromImageTest-750306572 None] Lock "cinder-9da71268-d221-4484-bf23-055b698b4636-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=29,cinder:UPDATE=53,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:37:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=41,cinder:UPDATE=57,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (0ad7b385-6124-445d-84b8-7f9fab79d9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6370bb-10de-4069-8791-138f7f3d1a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6370bb-10de-4069-8791-138f7f3d1a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100422114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e08cb12-5286-429f-8764-cc4fa76a972c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c817e8a-7999-47ea-9edb-6682911f1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c817e8a-7999-47ea-9edb-6682911f1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8ab2b7-6453-4e2e-b223-e13589d22132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8ab2b7-6453-4e2e-b223-e13589d22132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e08cb12-5286-429f-8764-cc4fa76a972c', 'volume_name': 'volume-4e08cb12-5286-429f-8764-cc4fa76a972c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5d508b-8002-4a44-9176-4b238d2ae438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5d508b-8002-4a44-9176-4b238d2ae438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c87d192-0012-4a8d-a82a-90596712f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume 4e08cb12-5286-429f-8764-cc4fa76a972c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e08cb12-5286-429f-8764-cc4fa76a972c', 'volume_size': 1} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100422114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e08cb12-5286-429f-8764-cc4fa76a972c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume 4e08cb12-5286-429f-8764-cc4fa76a972c {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:34 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:34 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c 1073741824 Nov 04 22:37:34 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (4bb5876c-4a9d-4335-9e99-6518f232f9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d39360-0b26-41e4-a599-d002e2369c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d39360-0b26-41e4-a599-d002e2369c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447123315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342f29ca-ce98-4728-893d-4e6acf8d9975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebf79f9-397c-49a3-910b-b942d7b9b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebf79f9-397c-49a3-910b-b942d7b9b971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f88686-5e4a-4f7c-a968-1456007efe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f88686-5e4a-4f7c-a968-1456007efe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342f29ca-ce98-4728-893d-4e6acf8d9975', 'volume_name': 'volume-342f29ca-ce98-4728-893d-4e6acf8d9975', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ef7c6-4908-4858-91e4-62c50e497fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ef7c6-4908-4858-91e4-62c50e497fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e918bd-aeeb-41de-8d01-98dcc174f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:34 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume 342f29ca-ce98-4728-893d-4e6acf8d9975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342f29ca-ce98-4728-893d-4e6acf8d9975', 'volume_size': 1} Nov 04 22:37:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (9348c13c-014f-4a33-8bf2-dba2a0eba351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5fde9f-3a6f-4760-a0e4-50da8913838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5fde9f-3a6f-4760-a0e4-50da8913838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759391506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e3018c-d343-46be-8e6d-6ed8708e61f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16565393-6a0f-414c-bd3c-f303ea227ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16565393-6a0f-414c-bd3c-f303ea227ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4473820-8714-4bf6-aa16-79e8d61ea833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4473820-8714-4bf6-aa16-79e8d61ea833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e3018c-d343-46be-8e6d-6ed8708e61f3', 'volume_name': 'volume-00e3018c-d343-46be-8e6d-6ed8708e61f3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffb4a0f-a5df-402b-826f-595edab69267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffb4a0f-a5df-402b-826f-595edab69267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c83991-7ec7-4a16-b623-e5dd46246149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Volume 00e3018c-d343-46be-8e6d-6ed8708e61f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e3018c-d343-46be-8e6d-6ed8708e61f3', 'volume_size': 1} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:35 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c 1073741824" returned: 0 in 0.621s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:35 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c Nov 04 22:37:35 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (1749164f-9929-4ba5-8598-9ed922c22ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d73bfd-01f2-4bad-9e2b-003593a3b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d73bfd-01f2-4bad-9e2b-003593a3b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935334579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf23d6af-0342-4b8f-bd7e-f55b81386a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d4a82e-abf3-4cb1-be70-86c9076f574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d4a82e-abf3-4cb1-be70-86c9076f574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244b1794-491a-4dea-8acd-c734120bdb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244b1794-491a-4dea-8acd-c734120bdb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf23d6af-0342-4b8f-bd7e-f55b81386a3e', 'volume_name': 'volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e374e66-476a-4d66-a235-0970445ba54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e374e66-476a-4d66-a235-0970445ba54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96193cf9-e7c2-4c90-b354-67c982e932a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Volume cf23d6af-0342-4b8f-bd7e-f55b81386a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e', 'volume_size': 1} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:35 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447123315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342f29ca-ce98-4728-893d-4e6acf8d9975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume 342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:35 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:35 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 1073741824 Nov 04 22:37:35 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c87d192-0012-4a8d-a82a-90596712f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e08cb12-5286-429f-8764-cc4fa76a972c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a2310-5a28-495e-b457-0d2292cc765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-4e08cb12-5286-429f-8764-cc4fa76a972c (4e08cb12-5286-429f-8764-cc4fa76a972c): created successfully Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a2310-5a28-495e-b457-0d2292cc765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (0ad7b385-6124-445d-84b8-7f9fab79d9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-47e46f51-7166-47fa-a517-d9ab74abce7b tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (57332ff1-2a90-4ee7-9f7f-2d6fa8b7f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d769cec7-aa5e-4dc9-a3d6-c34a2d5c4905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d769cec7-aa5e-4dc9-a3d6-c34a2d5c4905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710909188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75b7f7a-a8a7-4463-b52e-b05df55923d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:36Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f85f17-15e3-4d7b-ab15-1346de630e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f85f17-15e3-4d7b-ab15-1346de630e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88874c70-9377-4a0c-b1fd-aacfa533685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88874c70-9377-4a0c-b1fd-aacfa533685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75b7f7a-a8a7-4463-b52e-b05df55923d3', 'volume_name': 'volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ece807-9be1-44e7-8dd4-f1ed4d34b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ece807-9be1-44e7-8dd4-f1ed4d34b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75564950-e5b4-45bb-bdee-3f4c75b332de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Volume e75b7f7a-a8a7-4463-b52e-b05df55923d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3', 'volume_size': 1} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:36 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 1073741824" returned: 0 in 0.580s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:36 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 Nov 04 22:37:36 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (fe4f563c-ee1f-45ef-ac56-10c7c84d16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d302f82-09cb-4cf9-8ab1-4eab7f24d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d302f82-09cb-4cf9-8ab1-4eab7f24d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042382088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa4f810-5280-4eab-bf5b-d33ec2cd19d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:36Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2567a-efbb-480b-a1bf-1db32a4ea54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2567a-efbb-480b-a1bf-1db32a4ea54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3778d14b-bded-443c-9002-73bacd4b1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3778d14b-bded-443c-9002-73bacd4b1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa4f810-5280-4eab-bf5b-d33ec2cd19d4', 'volume_name': 'volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26593730-ecf8-41b8-b6b8-24c85565478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26593730-ecf8-41b8-b6b8-24c85565478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43699dc5-ad72-42ec-8b50-66c4854c8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Volume 0aa4f810-5280-4eab-bf5b-d33ec2cd19d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4', 'volume_size': 1} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:36 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975" returned: 0 in 0.506s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759391506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e3018c-d343-46be-8e6d-6ed8708e61f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Creating volume 00e3018c-d343-46be-8e6d-6ed8708e61f3 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:36 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e918bd-aeeb-41de-8d01-98dcc174f347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342f29ca-ce98-4728-893d-4e6acf8d9975', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 1073741824 Nov 04 22:37:36 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb85777e-f9c1-4c2e-8e9d-d0d52581f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:36 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-342f29ca-ce98-4728-893d-4e6acf8d9975 (342f29ca-ce98-4728-893d-4e6acf8d9975): created successfully Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb85777e-f9c1-4c2e-8e9d-d0d52581f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:36 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (4bb5876c-4a9d-4335-9e99-6518f232f9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:36 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-895b3c73-6ff6-4ae9-8ca3-0cfb34dc5acc tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (5cbba850-4cb8-4ae1-bbda-63476982d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87542d62-788e-47a6-bb7f-2d9f3a10fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87542d62-788e-47a6-bb7f-2d9f3a10fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017228210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0a5a05-2a32-43e4-a888-a8ad505be66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:37Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359367a6-9173-4d88-b50b-8217ff7d3c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359367a6-9173-4d88-b50b-8217ff7d3c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624539c5-f7bd-4f91-b823-87724621cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624539c5-f7bd-4f91-b823-87724621cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0a5a05-2a32-43e4-a888-a8ad505be66e', 'volume_name': 'volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6779045-3a50-4f2a-b92f-422ccf6c5156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6779045-3a50-4f2a-b92f-422ccf6c5156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f816dc33-0604-49a8-a159-ae672d8e17a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Volume ed0a5a05-2a32-43e4-a888-a8ad505be66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e', 'volume_size': 1} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (50d74890-82df-43be-82ee-272a0562cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8823d282-99ac-486c-acc6-fc5076c0d9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8823d282-99ac-486c-acc6-fc5076c0d9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1533154832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f3f3a-a56f-4082-8087-fdc5266f9afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:37Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f66997-9180-4065-961a-20601d3141a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f66997-9180-4065-961a-20601d3141a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854994e5-61da-40ed-8f82-a07b698716c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854994e5-61da-40ed-8f82-a07b698716c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1f3f3a-a56f-4082-8087-fdc5266f9afe', 'volume_name': 'volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439d289c-47c7-45c6-b13c-db95569f170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439d289c-47c7-45c6-b13c-db95569f170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f72077-4d00-4961-8534-ed1d53b17e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume ed1f3f3a-a56f-4082-8087-fdc5266f9afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe', 'volume_size': 1} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:37 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 1073741824" returned: 0 in 0.690s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:37 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 Nov 04 22:37:37 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (eae38ed3-b2e3-4342-aef8-8a69a8c8f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba19bddc-5329-41e5-8be4-20141cac6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba19bddc-5329-41e5-8be4-20141cac6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191085486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbba6200-1b8e-4f5c-b4a4-5547482bc5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:38Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4017f9-6bdc-4e14-83cd-007fb76f782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4017f9-6bdc-4e14-83cd-007fb76f782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4df6de-e701-4636-9ef9-96532d2edb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4df6de-e701-4636-9ef9-96532d2edb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbba6200-1b8e-4f5c-b4a4-5547482bc5db', 'volume_name': 'volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9f1ac-ca83-4b12-bc67-4c9ea553e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9f1ac-ca83-4b12-bc67-4c9ea553e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0de10e7-c2ee-43df-9e95-0b44c514adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:37 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume dbba6200-1b8e-4f5c-b4a4-5547482bc5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db', 'volume_size': 1} Nov 04 22:37:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:38 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3" returned: 0 in 0.497s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935334579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf23d6af-0342-4b8f-bd7e-f55b81386a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:35Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Creating volume cf23d6af-0342-4b8f-bd7e-f55b81386a3e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:38 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:38 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e 1073741824 Nov 04 22:37:38 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c83991-7ec7-4a16-b623-e5dd46246149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e3018c-d343-46be-8e6d-6ed8708e61f3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b349b481-98b3-44d4-b365-11b800d1ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Volume volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 (00e3018c-d343-46be-8e6d-6ed8708e61f3): created successfully Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b349b481-98b3-44d4-b365-11b800d1ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (9348c13c-014f-4a33-8bf2-dba2a0eba351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (54202918-128c-4100-b062-affb4c1429b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929af430-4e42-4af8-b315-a8727216ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4c9b7b98-7128-468d-80eb-d642f2ae7103 tempest-CreateVolumesFromImageTest-2063331279 None] Created volume successfully. Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929af430-4e42-4af8-b315-a8727216ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019932026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a541bd-9899-4dc5-b6fb-7db9055ff393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:38Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0d102f-cec6-42f4-9107-5ed18136b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0d102f-cec6-42f4-9107-5ed18136b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3393d-521f-45fd-8396-9816dee32659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3393d-521f-45fd-8396-9816dee32659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a541bd-9899-4dc5-b6fb-7db9055ff393', 'volume_name': 'volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ddd67-da4b-43dc-b498-b5b9c4face76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ddd67-da4b-43dc-b498-b5b9c4face76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3754c031-46f9-4dc4-9cdb-c51ff3247857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume d8a541bd-9899-4dc5-b6fb-7db9055ff393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393', 'volume_size': 1} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (2be53466-0f32-4bf4-9909-4a934606d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f37e8d-30b3-4b26-ab5c-88cce0cd27e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f37e8d-30b3-4b26-ab5c-88cce0cd27e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363920169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161c2ec3-80b6-40c0-b89d-b7ccd5aff97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:39Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab483d7-f5e9-4bd1-88a1-53a054e1fb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab483d7-f5e9-4bd1-88a1-53a054e1fb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7632bd-e59e-4213-a65b-e946c3768493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7632bd-e59e-4213-a65b-e946c3768493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161c2ec3-80b6-40c0-b89d-b7ccd5aff97b', 'volume_name': 'volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d45b4c-c798-4c91-8992-c2d899340d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d45b4c-c798-4c91-8992-c2d899340d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac1f1db-b59f-43fd-8f28-c99166f953ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume 161c2ec3-80b6-40c0-b89d-b7ccd5aff97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b', 'volume_size': 1} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:38 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e 1073741824" returned: 0 in 0.573s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:38 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e Nov 04 22:37:38 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:39 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" returned: 0 in 0.319s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.918s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710909188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75b7f7a-a8a7-4463-b52e-b05df55923d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:36Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Creating volume e75b7f7a-a8a7-4463-b52e-b05df55923d3 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:39 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 1073741824 Nov 04 22:37:39 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (a4079f3a-7240-455b-9f8e-41e1ef4e7bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c771d647-f251-456b-ae46-2109da75d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96193cf9-e7c2-4c90-b354-67c982e932a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec236b0e-cbe4-48d4-bb4a-58c1478f8020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c771d647-f251-456b-ae46-2109da75d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017367537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6104b0dc-a628-4d11-8812-1d9a233a55a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:39Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c43ad09-bd9f-47f7-84bb-62b81f215d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c43ad09-bd9f-47f7-84bb-62b81f215d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c747af-17c0-4fe3-97f5-f8a8af9d99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c747af-17c0-4fe3-97f5-f8a8af9d99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6104b0dc-a628-4d11-8812-1d9a233a55a6', 'volume_name': 'volume-6104b0dc-a628-4d11-8812-1d9a233a55a6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678fbb11-9982-4d15-8fdc-ca0dfd89c152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678fbb11-9982-4d15-8fdc-ca0dfd89c152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d92906-fe3e-4c44-98e1-13e1313685c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume 6104b0dc-a628-4d11-8812-1d9a233a55a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6104b0dc-a628-4d11-8812-1d9a233a55a6', 'volume_size': 1} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Volume volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e (cf23d6af-0342-4b8f-bd7e-f55b81386a3e): created successfully Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec236b0e-cbe4-48d4-bb4a-58c1478f8020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (1749164f-9929-4ba5-8598-9ed922c22ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-89dcabc3-b7fb-458d-877a-c9fcb4275022 tempest-CreateVolumesFromImageTest-2063331279 None] Created volume successfully. Nov 04 22:37:39 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 1073741824" returned: 0 in 0.515s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:39 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 Nov 04 22:37:39 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Flow 'volume_create_manager' (ecc7e831-75f7-4abb-b18a-9cda2e7e57cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfa6efc-2fe5-4f88-9bd2-2290818151c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfa6efc-2fe5-4f88-9bd2-2290818151c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e10fa9-5466-4b0f-adc6-ee745fd8f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf06cad47404034bb4eebfab9d222fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:40Z,use_quota=True,user_id='d1ad8aefefd2449aaf92b41c999f4d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(604980c5-b64f-4401-bb23-4f49acdd4e8e),volume_type_id=604980c5-b64f-4401-bb23-4f49acdd4e8e)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6816a46a-4095-436f-8052-663e517bc9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6816a46a-4095-436f-8052-663e517bc9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33960fbe-f708-409f-ba91-25a9b573b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.315s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042382088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa4f810-5280-4eab-bf5b-d33ec2cd19d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:36Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Creating volume 0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75564950-e5b4-45bb-bdee-3f4c75b332de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14226f-067f-41ba-ae7a-bdb7c4ac2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:39 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 1073741824 Nov 04 22:37:39 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Volume volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 (e75b7f7a-a8a7-4463-b52e-b05df55923d3): created successfully Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14226f-067f-41ba-ae7a-bdb7c4ac2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (57332ff1-2a90-4ee7-9f7f-2d6fa8b7f773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7c5cf33d-feb5-4812-a754-23dc5a45313b tempest-CreateVolumesFromImageTest-2063331279 None] Created volume successfully. Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33960fbe-f708-409f-ba91-25a9b573b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83e10fa9-5466-4b0f-adc6-ee745fd8f9e8', 'volume_name': 'volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8', 'volume_size': 1, 'image_id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a5dca20ffddda7a43ad665027f9b998', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bf06cad47404034bb4eebfab9d222fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e55259575c3f6903f8513c9068166a74c31ced54becd4fc855277d3125cbc1382d55f289c777897ad2c84cdd2a2647ea7c3c09509dd7dd2b4136c6a6a271812e', 'id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8e9480-70d0-4709-8efc-d3a0b98f756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8e9480-70d0-4709-8efc-d3a0b98f756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f4701-2299-4552-8e62-119d1151cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8', 'volume_size': 1, 'image_id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a5dca20ffddda7a43ad665027f9b998', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bf06cad47404034bb4eebfab9d222fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e55259575c3f6903f8513c9068166a74c31ced54becd4fc855277d3125cbc1382d55f289c777897ad2c84cdd2a2647ea7c3c09509dd7dd2b4136c6a6a271812e', 'id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Trying to clone 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 from image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Image download 0.00 MB at 0.00 MB/s Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4212ea-622e-4802-be96-3094ea657c79]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:40 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 1073741824" returned: 0 in 0.493s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:40 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:40 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:40 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 Nov 04 22:37:40 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:40 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:40 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.431s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017228210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0a5a05-2a32-43e4-a888-a8ad505be66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6db20b87674732aa2328a94c8f94ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:37Z,use_quota=True,user_id='ee8417a766134936b1a26977d9d78b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Creating volume ed0a5a05-2a32-43e4-a888-a8ad505be66e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:40 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e 1073741824 Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43699dc5-ad72-42ec-8b50-66c4854c8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:40 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b2a2f2-e009-4182-a9a4-e2ec7294e8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Volume volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 (0aa4f810-5280-4eab-bf5b-d33ec2cd19d4): created successfully Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b2a2f2-e009-4182-a9a4-e2ec7294e8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (fe4f563c-ee1f-45ef-ac56-10c7c84d16b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:40 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:40 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6ffc2b20-bfde-4c99-9ab4-fdd572f8ddf2 tempest-CreateVolumesFromImageTest-2063331279 None] Created volume successfully. Nov 04 22:37:41 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Temporary image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 is fetched for user d1ad8aefefd2449aaf92b41c999f4d31. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a898c3-a8cf-49df-b9ae-68995f5082d6]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:41 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e 1073741824" returned: 0 in 0.482s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:41 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:41 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:41 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e Nov 04 22:37:41 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:41 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:41 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e" returned: 0 in 0.279s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.029s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1533154832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f3f3a-a56f-4082-8087-fdc5266f9afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:37Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume ed1f3f3a-a56f-4082-8087-fdc5266f9afe {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:41 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:41 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:41 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:41 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe 1073741824 Nov 04 22:37:41 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f816dc33-0604-49a8-a159-ae672d8e17a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e5d081-c7e0-4a3a-842f-d353f6b3d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:41 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Volume volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e (ed0a5a05-2a32-43e4-a888-a8ad505be66e): created successfully Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e5d081-c7e0-4a3a-842f-d353f6b3d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Flow 'volume_create_manager' (5cbba850-4cb8-4ae1-bbda-63476982d224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-71eaf7fd-daab-477f-8fce-028965462e4d tempest-CreateVolumesFromImageTest-2063331279 None] Created volume successfully. Nov 04 22:37:41 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:37:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:42 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe 1073741824" returned: 0 in 0.453s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:42 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe Nov 04 22:37:42 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:42 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" returned: 0 in 0.243s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.348s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191085486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbba6200-1b8e-4f5c-b4a4-5547482bc5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:38Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume dbba6200-1b8e-4f5c-b4a4-5547482bc5db {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:42 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f72077-4d00-4961-8534-ed1d53b17e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:42 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db 1073741824 Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df04d2f-b352-4e00-914a-466d9d0ea79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:42 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:42 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe (ed1f3f3a-a56f-4082-8087-fdc5266f9afe): created successfully Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df04d2f-b352-4e00-914a-466d9d0ea79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (50d74890-82df-43be-82ee-272a0562cd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0be3d945-1351-4f9e-bb84-21f78b3c4eff tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:42 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-ed0a5a05-2a32-43e4-a888-a8ad505be66e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db 1073741824" returned: 0 in 0.446s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-ed0a5a05-2a32-43e4-a888-a8ad505be66e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-quobyte-ed0a5a05-2a32-43e4-a888-a8ad505be66e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:42 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db Nov 04 22:37:42 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-ed0a5a05-2a32-43e4-a888-a8ad505be66e" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c8a539-f5af-4f67-b6a2-a627b56234bd]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:42 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e Nov 04 22:37:42 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:43 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" returned: 0 in 0.271s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.781s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating offline snapshot a40148ca-b7f7-4b54-bcde-3ddfe6568b77 of volume 342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0de10e7-c2ee-43df-9e95-0b44c514adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30b46b-73b1-48fd-aca9-e51025305388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf44b56-9d44-42af-a951-87aa2cb31928]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:43 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db (dbba6200-1b8e-4f5c-b4a4-5547482bc5db): created successfully Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30b46b-73b1-48fd-aca9-e51025305388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (eae38ed3-b2e3-4342-aef8-8a69a8c8f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7c71b69a-fe23-4752-b444-294083f3ec24 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:43 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 Nov 04 22:37:43 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:43 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e" returned: 0 in 0.413s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:43 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e Nov 04 22:37:43 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:43 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975" returned: 0 in 0.405s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:43 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 1G Nov 04 22:37:43 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:43 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed0a5a05-2a32-43e4-a888-a8ad505be66e" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-ed0a5a05-2a32-43e4-a888-a8ad505be66e" released by "delete_volume" :: held 0.745s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Created reservations ['c9914e8d-7c2b-40dc-9d9c-5e16f230ef00', 'd4ae1abf-2e58-491d-aaea-d29e844f6492', '93a189ae-f998-4414-87dc-34e91de715e6', '1068e25b-4d4f-4289-a808-e3564d505ddc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:43 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:43 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:44 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.307s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-quobyte-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Deleted volume successfully. Nov 04 22:37:44 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 1G" returned: 0 in 0.507s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342f29ca-ce98-4728-893d-4e6acf8d9975 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:44 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342f29ca-ce98-4728-893d-4e6acf8d9975 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 Nov 04 22:37:44 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-eb99f79c-f872-4434-b81f-0ee09365c00c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-ed0a5a05-2a32-43e4-a888-a8ad505be66e-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[647bab06-5a35-4374-ae05-9e49d00381a2]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 Nov 04 22:37:44 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342f29ca-ce98-4728-893d-4e6acf8d9975 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 is being set with open permissions: ugo+rw Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 Nov 04 22:37:44 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" returned: 0 in 0.428s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4 Nov 04 22:37:44 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77" returned: 0 in 0.262s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info Nov 04 22:37:44 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4" released by "delete_volume" :: held 0.741s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Created reservations ['de9805d9-d108-4cbc-97e5-e10feb021c09', 'f33d6340-40c3-4f50-b93f-bb250587f179', '9e079ab3-ca7d-4c3c-ac9c-bca6c758b24c', '9dd1012c-489f-4a1f-bda0-74da8f802bd4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:44 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:44 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:44 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:44 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info is being set with open permissions: ugo+rw Nov 04 22:37:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:45 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info Nov 04 22:37:45 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-e75b7f7a-a8a7-4463-b52e-b05df55923d3-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-e75b7f7a-a8a7-4463-b52e-b05df55923d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:45 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Deleted volume successfully. Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-quobyte-e75b7f7a-a8a7-4463-b52e-b05df55923d3" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-2aca30b6-af81-427a-8c5f-f14db6308e99 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-0aa4f810-5280-4eab-bf5b-d33ec2cd19d4-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-e75b7f7a-a8a7-4463-b52e-b05df55923d3" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:45 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.info" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[369ed69b-29a9-4cdc-b032-30d03ed20d0c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.870s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019932026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a541bd-9899-4dc5-b6fb-7db9055ff393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:38Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume d8a541bd-9899-4dc5-b6fb-7db9055ff393 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:45 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:45 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 1073741824 Nov 04 22:37:45 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3c025c0a-7ab1-42cf-a82a-7b7f6a6a413c tempest-CreateVolumesFromSnapshotTest-91674303 None] Create snapshot completed successfully Nov 04 22:37:45 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 Nov 04 22:37:45 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:45 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3" returned: 0 in 0.424s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:45 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3 Nov 04 22:37:45 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:45 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 1073741824" returned: 0 in 0.539s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:45 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 Nov 04 22:37:45 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:46 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (af263692-3041-4608-9566-98703a5832be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af85cb81-97e4-42c0-ba41-d8a6ba4a1a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e75b7f7a-a8a7-4463-b52e-b05df55923d3" returned: 0 in 0.327s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af85cb81-97e4-42c0-ba41-d8a6ba4a1a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1470383963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da69e582-b075-4c04-97aa-0f719e4cbc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:46Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb39646-53eb-4a5a-8793-9924e172fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb39646-53eb-4a5a-8793-9924e172fd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570a72a2-65e1-42e6-bbf5-dccbdbf294c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570a72a2-65e1-42e6-bbf5-dccbdbf294c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da69e582-b075-4c04-97aa-0f719e4cbc57', 'volume_name': 'volume-da69e582-b075-4c04-97aa-0f719e4cbc57', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291c4580-2e8f-439f-9517-f1cebdba0029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291c4580-2e8f-439f-9517-f1cebdba0029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25891614-b156-4dff-9bac-7f2f9f1388d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume da69e582-b075-4c04-97aa-0f719e4cbc57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da69e582-b075-4c04-97aa-0f719e4cbc57', 'volume_size': 1} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-e75b7f7a-a8a7-4463-b52e-b05df55923d3" released by "delete_volume" :: held 0.892s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Created reservations ['dd0905c1-af32-4f88-a68d-542d637fcae8', '4f8a69e1-20f6-4fad-a444-d66e4d0f81fc', 'd170975b-e584-4a7d-8495-863802075803', 'b25e8b39-cb26-41ed-8088-1f66dd2facb3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:46 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393" returned: 0 in 0.357s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.614s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363920169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161c2ec3-80b6-40c0-b89d-b7ccd5aff97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:39Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume 161c2ec3-80b6-40c0-b89d-b7ccd5aff97b {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3754c031-46f9-4dc4-9cdb-c51ff3247857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185e9ce5-abb6-4a4f-8591-bd1a6264d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b 1073741824 Nov 04 22:37:46 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 (d8a541bd-9899-4dc5-b6fb-7db9055ff393): created successfully Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185e9ce5-abb6-4a4f-8591-bd1a6264d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (54202918-128c-4100-b062-affb4c1429b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bee96f87-d92f-42a2-b40d-1aae94a5334e tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:46 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:46 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (bee54230-a33a-42d6-87e2-e485c1a9df0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697643c8-4282-4467-925f-1eb77da0bb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697643c8-4282-4467-925f-1eb77da0bb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022019130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9f59b5-f5b4-4e7d-a689-ab304619d6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:46Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2264e145-ca1c-4536-ba33-d37a8865a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2264e145-ca1c-4536-ba33-d37a8865a74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7957fba4-e0c5-4bf2-994a-bfb19b318fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7957fba4-e0c5-4bf2-994a-bfb19b318fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9f59b5-f5b4-4e7d-a689-ab304619d6e3', 'volume_name': 'volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0438e7c-5542-46c2-b9d9-81870970f636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0438e7c-5542-46c2-b9d9-81870970f636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1385e8d0-a71f-45e2-acc6-175ad16fee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume 7a9f59b5-f5b4-4e7d-a689-ab304619d6e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3', 'volume_size': 1} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:46 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.340s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Deleted volume successfully. Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-c9f9d7b1-1a75-4a3c-992b-434c769cacd2 tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-e75b7f7a-a8a7-4463-b52e-b05df55923d3-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:46 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b 1073741824" returned: 0 in 0.649s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:47 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b Nov 04 22:37:47 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (61441f65-eef8-46fb-9a64-e95593e33206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd72d01-994a-4b43-932b-473577540c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd72d01-994a-4b43-932b-473577540c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1050812611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c15b17-d303-4711-880c-c261024c61a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:47Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91b49e7-e7ad-48dd-bcb9-aab5d7611710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91b49e7-e7ad-48dd-bcb9-aab5d7611710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4aeed8-9b3b-4c26-9c3c-13092a2c363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4aeed8-9b3b-4c26-9c3c-13092a2c363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c15b17-d303-4711-880c-c261024c61a0', 'volume_name': 'volume-63c15b17-d303-4711-880c-c261024c61a0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a54d32-19e7-4db7-9574-dc5e30908435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a54d32-19e7-4db7-9574-dc5e30908435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aee6da-472f-46e4-b156-1a4554c0ee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume 63c15b17-d303-4711-880c-c261024c61a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c15b17-d303-4711-880c-c261024c61a0', 'volume_size': 1} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.075s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017367537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6104b0dc-a628-4d11-8812-1d9a233a55a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a8612e47a6475784656feb90c9bb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:39Z,use_quota=True,user_id='ee3ee93751b047bbb7ed4bed67bda6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Creating volume 6104b0dc-a628-4d11-8812-1d9a233a55a6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:47 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac1f1db-b59f-43fd-8f28-c99166f953ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 1073741824 Nov 04 22:37:47 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aaf2cd-0447-43d2-8bc3-089c44373164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b (161c2ec3-80b6-40c0-b89d-b7ccd5aff97b): created successfully Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aaf2cd-0447-43d2-8bc3-089c44373164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (2be53466-0f32-4bf4-9909-4a934606d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-29ce4ad9-0520-47e9-8197-762b74014664 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-cf23d6af-0342-4b8f-bd7e-f55b81386a3e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-cf23d6af-0342-4b8f-bd7e-f55b81386a3e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-quobyte-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3af49-243c-4391-bc37-76d892b45b2f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (56b33757-43a9-4539-91c9-16a4bc101444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609ac5d0-31c4-4202-b51f-5f58aeca91ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609ac5d0-31c4-4202-b51f-5f58aeca91ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773617469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f00b48-a3ec-4c39-a70b-02a269319982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:48Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b535f4-a6b1-448b-9cd1-44c3e6ab04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b535f4-a6b1-448b-9cd1-44c3e6ab04db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1448fa1d-8f38-4014-a886-86d4e4788468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1448fa1d-8f38-4014-a886-86d4e4788468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f00b48-a3ec-4c39-a70b-02a269319982', 'volume_name': 'volume-48f00b48-a3ec-4c39-a70b-02a269319982', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e6ec16-a89a-4a3f-a074-9aa98bb5576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e6ec16-a89a-4a3f-a074-9aa98bb5576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70966b8e-3586-4441-abd9-73f359121bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume 48f00b48-a3ec-4c39-a70b-02a269319982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f00b48-a3ec-4c39-a70b-02a269319982', 'volume_size': 1} Nov 04 22:37:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:47 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e Nov 04 22:37:47 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 1073741824" returned: 0 in 0.721s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:48 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 Nov 04 22:37:48 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (33b9754d-e763-4a32-9cc2-891f9f9cb727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82631f2b-c375-463f-bd86-389ff588efd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82631f2b-c375-463f-bd86-389ff588efd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140604583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f77fbc-0677-4781-9650-f1d76f73276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:48Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c8d918-68c5-4134-b5b7-4e9f8cda0447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c8d918-68c5-4134-b5b7-4e9f8cda0447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd17997-2d8b-417e-965a-8116f3a47e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd17997-2d8b-417e-965a-8116f3a47e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f77fbc-0677-4781-9650-f1d76f73276f', 'volume_name': 'volume-30f77fbc-0677-4781-9650-f1d76f73276f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a301f2a-9788-43f9-9bd8-e9a67b53b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a301f2a-9788-43f9-9bd8-e9a67b53b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3475737-6f1a-4ec4-932a-eb190ea06a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume 30f77fbc-0677-4781-9650-f1d76f73276f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f77fbc-0677-4781-9650-f1d76f73276f', 'volume_size': 1} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" returned: 0 in 0.609s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:48 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e Nov 04 22:37:48 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.456s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e10fa9-5466-4b0f-adc6-ee745fd8f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf06cad47404034bb4eebfab9d222fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:40Z,use_quota=True,user_id='d1ad8aefefd2449aaf92b41c999f4d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(604980c5-b64f-4401-bb23-4f49acdd4e8e),volume_type_id=604980c5-b64f-4401-bb23-4f49acdd4e8e)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Creating volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:48 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d92906-fe3e-4c44-98e1-13e1313685c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6104b0dc-a628-4d11-8812-1d9a233a55a6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96982e-e6dd-4f0e-b367-33de7ec8fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:48 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1073741824 Nov 04 22:37:48 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Volume volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 (6104b0dc-a628-4d11-8812-1d9a233a55a6): created successfully Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96982e-e6dd-4f0e-b367-33de7ec8fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Flow 'volume_create_manager' (a4079f3a-7240-455b-9f8e-41e1ef4e7bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9cd0701c-e07d-4ac9-a678-db36ced11855 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created volume successfully. Nov 04 22:37:48 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" returned: 0 in 0.273s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-cf23d6af-0342-4b8f-bd7e-f55b81386a3e" released by "delete_volume" :: held 0.947s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Created reservations ['efdacc05-7666-49b0-b636-fae86d2a4516', 'ac9729df-0c77-4993-aeaf-c9050ad42037', '79db08cb-230d-4390-90cc-5f8071d77cd5', 'b033732c-6e38-4d1c-bfda-b121ab1e817e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:48 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:48 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1073741824" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:48 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 Nov 04 22:37:48 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:48 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Deleted volume successfully. Nov 04 22:37:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-cb6b0a2c-66f8-4390-99b1-31a678c5d23c tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-cf23d6af-0342-4b8f-bd7e-f55b81386a3e-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-6104b0dc-a628-4d11-8812-1d9a233a55a6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-6104b0dc-a628-4d11-8812-1d9a233a55a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-6104b0dc-a628-4d11-8812-1d9a233a55a6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:49 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-6104b0dc-a628-4d11-8812-1d9a233a55a6" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" returned: 0 in 0.297s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1470383963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da69e582-b075-4c04-97aa-0f719e4cbc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:46Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume da69e582-b075-4c04-97aa-0f719e4cbc57 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:49 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[13368c7d-d433-4554-8df6-7e6e9f2d9f74]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 1073741824 Nov 04 22:37:49 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Attempting download of c266cbf6-d93c-4fdf-a962-6a7d8257fa60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}])) to volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c240781-ca3e-41fc-a149-73562b2bcdd0]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 Nov 04 22:37:49 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg Nov 04 22:37:49 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg" returned: 0 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 1073741824" returned: 0 in 0.476s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6 Nov 04 22:37:49 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 Nov 04 22:37:49 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg Nov 04 22:37:49 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-00e3018c-d343-46be-8e6d-6ed8708e61f3-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-00e3018c-d343-46be-8e6d-6ed8708e61f3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "cinder-quobyte-00e3018c-d343-46be-8e6d-6ed8708e61f3" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-00e3018c-d343-46be-8e6d-6ed8708e61f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674cad2-a083-4be7-8871-f032b85dfb63]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-6104b0dc-a628-4d11-8812-1d9a233a55a6" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-6104b0dc-a628-4d11-8812-1d9a233a55a6" released by "delete_volume" :: held 0.819s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:49 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg" returned: 1 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_bk_xrodg' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a3de8f-8da5-491b-9484-ba4319d48897]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:49 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57" returned: 0 in 0.330s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:50 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 Nov 04 22:37:50 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.404s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022019130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9f59b5-f5b4-4e7d-a689-ab304619d6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:46Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume 7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:50 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['55229a2d-cdcf-414b-a9fa-64a93c7a864a', '3e7652f2-4b9d-496b-b9a8-419686ba6098', '5502a49f-1e63-4bb4-95dd-b6918ba7e940', 'eb3c3415-1910-4733-9273-f24f2b064781'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:50 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 1073741824 Nov 04 22:37:50 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25891614-b156-4dff-9bac-7f2f9f1388d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da69e582-b075-4c04-97aa-0f719e4cbc57', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4127a070-8b55-4263-bfc7-ed76b67d0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:50 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:50 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-da69e582-b075-4c04-97aa-0f719e4cbc57 (da69e582-b075-4c04-97aa-0f719e4cbc57): created successfully Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4127a070-8b55-4263-bfc7-ed76b67d0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (af263692-3041-4608-9566-98703a5832be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1dd11b99-0e65-478b-acd7-ec05c7a6335f tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:50 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:50 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" acquired by "delete_volume" :: waited 0.043s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:50 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3" returned: 0 in 0.588s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b89388e-0420-45f0-95b5-550f6e9eb773]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3 Nov 04 22:37:50 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD Nov 04 22:37:50 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.453s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ae3f91d0-c63b-4187-bec1-f7cc2ec2289a tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-6104b0dc-a628-4d11-8812-1d9a233a55a6-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:50 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b Nov 04 22:37:50 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 1073741824" returned: 0 in 0.794s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:50 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-00e3018c-d343-46be-8e6d-6ed8708e61f3" returned: 0 in 0.450s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 Nov 04 22:37:50 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-quobyte-00e3018c-d343-46be-8e6d-6ed8708e61f3" released by "delete_volume" :: held 1.105s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:50 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD" returned: 1 in 0.578s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] c266cbf6-d93c-4fdf-a962-6a7d8257fa60 was raw, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:37:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 Nov 04 22:37:51 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Created reservations ['15ffe4f8-9cf6-44d7-a7c9-04028cfcb06e', '76a0672a-54ae-40bc-af84-d00b83233522', 'e8969084-dbd4-4d16-8546-f5508c1280af', 'ba6e05dc-3bc5-4f22-891d-18c3ed25da83'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:51 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" returned: 0 in 0.540s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b Nov 04 22:37:51 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" returned: 0 in 0.319s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1050812611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c15b17-d303-4711-880c-c261024c61a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:47Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume 63c15b17-d303-4711-880c-c261024c61a0 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:51 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:51 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1385e8d0-a71f-45e2-acc6-175ad16fee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:51 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 1073741824 Nov 04 22:37:51 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a2a783-4e06-4de3-8050-fe3ab65e6268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 (7a9f59b5-f5b4-4e7d-a689-ab304619d6e3): created successfully Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a2a783-4e06-4de3-8050-fe3ab65e6268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (bee54230-a33a-42d6-87e2-e485c1a9df0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e48c66a4-9e07-43e2-a646-13d41929c78c tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:51 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b" released by "delete_volume" :: held 0.976s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['1b2b105c-abad-4436-b486-f38b1503405f', '68004bcc-0e01-4f51-958b-41a28767513e', '9f30e119-8fef-4b43-97f7-8e9f7c8581b6', '95c40273-2397-48b0-8775-c5cd252b2850'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Deleted volume successfully. Nov 04 22:37:51 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:51 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" returned: 0 in 0.643s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c266cbf6-d93c-4fdf-a962-6a7d8257fa60_3lmivsstdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-42109023-6297-4514-a8c2-b6b9b61633ba tempest-CreateVolumesFromImageTest-2063331279 None] Lock "cinder-00e3018c-d343-46be-8e6d-6ed8708e61f3-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:51 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1G Nov 04 22:37:51 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 1073741824" returned: 0 in 0.605s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:51 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:37:51 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 Nov 04 22:37:51 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a8f63412-3dcb-4424-8d59-7c3ac45557f8 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-161c2ec3-80b6-40c0-b89d-b7ccd5aff97b-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:52 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 1G" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Downloaded image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}])) to volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Temporary image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 for user d1ad8aefefd2449aaf92b41c999f4d31 is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Marking volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Copying metadata from image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 to 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Creating volume glance metadata for volume 83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 backed by image c266cbf6-d93c-4fdf-a962-6a7d8257fa60 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8a5dca20ffddda7a43ad665027f9b998', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f4701-2299-4552-8e62-119d1151cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8', 'volume_size': 1, 'image_id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a5dca20ffddda7a43ad665027f9b998', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bf06cad47404034bb4eebfab9d222fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e55259575c3f6903f8513c9068166a74c31ced54becd4fc855277d3125cbc1382d55f289c777897ad2c84cdd2a2647ea7c3c09509dd7dd2b4136c6a6a271812e', 'id': 'c266cbf6-d93c-4fdf-a962-6a7d8257fa60', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c266cbf6-d93c-4fdf-a962-6a7d8257fa60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714e77a6-671a-4a60-850f-50a1fd225464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:52 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Volume volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 (83e10fa9-5466-4b0f-adc6-ee745fd8f9e8): created successfully Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714e77a6-671a-4a60-850f-50a1fd225464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Flow 'volume_create_manager' (ecc7e831-75f7-4abb-b18a-9cda2e7e57cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0d915bcf-6246-4cfe-aae7-dae5f6202460 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Created volume successfully. Nov 04 22:37:52 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.419s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773617469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f00b48-a3ec-4c39-a70b-02a269319982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:48Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume 48f00b48-a3ec-4c39-a70b-02a269319982 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:52 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aee6da-472f-46e4-b156-1a4554c0ee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c15b17-d303-4711-880c-c261024c61a0', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0eae50-8c10-4847-bcd6-6bcb6091303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:52 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 1073741824 Nov 04 22:37:52 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:52 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-63c15b17-d303-4711-880c-c261024c61a0 (63c15b17-d303-4711-880c-c261024c61a0): created successfully Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0eae50-8c10-4847-bcd6-6bcb6091303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (61441f65-eef8-46fb-9a64-e95593e33206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7682415a-2807-4eb5-8398-6c7fd2978530 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-d8a541bd-9899-4dc5-b6fb-7db9055ff393-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-d8a541bd-9899-4dc5-b6fb-7db9055ff393-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:52 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-d8a541bd-9899-4dc5-b6fb-7db9055ff393" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 1073741824" returned: 0 in 0.555s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-d8a541bd-9899-4dc5-b6fb-7db9055ff393" acquired by "delete_volume" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ebe37-5279-477c-8652-34b6f63ae4cf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:52 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 Nov 04 22:37:52 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Acquiring lock "cinder-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:52 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 Nov 04 22:37:52 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "cinder-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Acquiring lock "cinder-quobyte-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "cinder-quobyte-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" acquired by "delete_volume" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f382e2-f5d9-4bfe-907e-43bad74c71f6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:53 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982" returned: 0 in 0.338s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140604583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f77fbc-0677-4781-9650-f1d76f73276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcf2bae52da458ab0a17688d688ff4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:37:48Z,use_quota=True,user_id='852611e59a5d4bea82eb86e9e68581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Creating volume 30f77fbc-0677-4781-9650-f1d76f73276f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:37:53 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:53 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 Nov 04 22:37:53 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70966b8e-3586-4441-abd9-73f359121bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f00b48-a3ec-4c39-a70b-02a269319982', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:53 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f 1073741824 Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58657d-1a4b-4799-8fa2-86e25f158142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:53 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-48f00b48-a3ec-4c39-a70b-02a269319982 (48f00b48-a3ec-4c39-a70b-02a269319982): created successfully Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58657d-1a4b-4799-8fa2-86e25f158142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (56b33757-43a9-4539-91c9-16a4bc101444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b1a2c022-5fa6-4ef9-8c6a-ea5cb88e86f5 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:53 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393" returned: 0 in 0.505s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:53 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393 Nov 04 22:37:53 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" returned: 0 in 0.451s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:53 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8 Nov 04 22:37:53 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8a541bd-9899-4dc5-b6fb-7db9055ff393" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-d8a541bd-9899-4dc5-b6fb-7db9055ff393" released by "delete_volume" :: held 1.036s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['f3a3a023-7064-4da2-80e9-2a23dbcf63c5', '8fe390af-6653-406b-b9ec-3a9445acf7a3', '88dc7f69-37e4-4532-bf23-3b21d1313e37', 'bb8f287e-8149-4e9e-8856-df82a9b21c37'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:53 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f 1073741824" returned: 0 in 0.661s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:53 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:53 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f Nov 04 22:37:53 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "cinder-quobyte-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8" released by "delete_volume" :: held 0.913s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:54 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:54 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Created reservations ['5e00fe16-d121-4c6c-b252-17f8f983f7d7', '99a491cb-b9fc-4062-bc1d-d2f2ee2d2e98', '878d21a1-d94d-4cfe-83cb-6f84bdb790ab', 'cc1ad633-a8f2-4aca-9230-fd0bb0d7afa3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:54 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:54 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:54 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3475737-6f1a-4ec4-932a-eb190ea06a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f77fbc-0677-4781-9650-f1d76f73276f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ea2af6-4f0f-4c89-8c35-d2e6a1ee4778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:54 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Volume volume-30f77fbc-0677-4781-9650-f1d76f73276f (30f77fbc-0677-4781-9650-f1d76f73276f): created successfully Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ea2af6-4f0f-4c89-8c35-d2e6a1ee4778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Flow 'volume_create_manager' (33b9754d-e763-4a32-9cc2-891f9f9cb727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:37:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-02037c44-f942-4437-ac6e-91ab55d32d76 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created volume successfully. Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4c50204e-dbed-4e99-b1ca-d30a7bf8785d tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-d8a541bd-9899-4dc5-b6fb-7db9055ff393-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:54 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.290s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Deleted volume successfully. Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-63098958-1f10-4bc1-a411-dc22fb41e930 tempest-VolumeAndVolumeTypeFromImageTest-1682758165 None] Lock "cinder-83e10fa9-5466-4b0f-adc6-ee745fd8f9e8-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-30f77fbc-0677-4781-9650-f1d76f73276f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-30f77fbc-0677-4781-9650-f1d76f73276f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-dbba6200-1b8e-4f5c-b4a4-5547482bc5db-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-dbba6200-1b8e-4f5c-b4a4-5547482bc5db-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-30f77fbc-0677-4781-9650-f1d76f73276f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-30f77fbc-0677-4781-9650-f1d76f73276f" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45507f-086f-43ed-ab35-fef52ced3a0e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" acquired by "delete_volume" :: waited 0.031s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9cc8a-1d27-4f05-9eea-a751335e5f64]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:55 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f Nov 04 22:37:55 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:55 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db Nov 04 22:37:55 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:55 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f" returned: 0 in 0.481s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:55 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f Nov 04 22:37:55 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:55 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" returned: 0 in 0.460s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:55 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db Nov 04 22:37:55 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:55 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-30f77fbc-0677-4781-9650-f1d76f73276f" returned: 0 in 0.301s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-30f77fbc-0677-4781-9650-f1d76f73276f" released by "delete_volume" :: held 0.840s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:55 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" returned: 0 in 0.335s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-dbba6200-1b8e-4f5c-b4a4-5547482bc5db" released by "delete_volume" :: held 0.860s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:55 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['4a6ddce7-5647-4310-9695-d116a2f1149c', '1e920cdf-29e5-4421-a683-b901efd1c98e', '9881f104-0004-4e45-89f1-868f9d9375b2', '3f8b6b08-fc46-46f1-8a35-a856d042d1c5'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['c5b956e3-fe1b-4a98-b63c-cd520047df45', '7bb65724-0607-4ef5-ae96-6d534f1237f2', 'a0ba9444-a477-45f1-b423-35927f8d5366', 'ade96318-c15d-4803-8625-0f7b9f82d029'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:56 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:56 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-48f00b48-a3ec-4c39-a70b-02a269319982-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:56 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:56 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-ed1f3f3a-a56f-4082-8087-fdc5266f9afe-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-48f00b48-a3ec-4c39-a70b-02a269319982-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-ed1f3f3a-a56f-4082-8087-fdc5266f9afe-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-48f00b48-a3ec-4c39-a70b-02a269319982" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-48f00b48-a3ec-4c39-a70b-02a269319982" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cacd0-c9b9-46b3-a26e-f9f79d447985]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" acquired by "delete_volume" :: waited 0.042s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a855f7c9-6486-4f58-89b5-1fd2e314d72c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:56 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.528s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:56 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 Nov 04 22:37:56 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:56 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.530s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:56 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:56 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d2120f7a-2e8b-4f88-a631-18607a4b2412 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-30f77fbc-0677-4781-9650-f1d76f73276f-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:37:56 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe Nov 04 22:37:56 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-89af7302-4e20-47a0-8926-edd4c9138717 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-dbba6200-1b8e-4f5c-b4a4-5547482bc5db-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:57 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.389s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:37:57 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" returned: 0 in 0.550s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:57 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982" returned: 0 in 0.662s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:57 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe Nov 04 22:37:57 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:57 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982 Nov 04 22:37:57 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:57 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" returned: 0 in 0.360s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-ed1f3f3a-a56f-4082-8087-fdc5266f9afe" released by "delete_volume" :: held 1.011s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:57 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-48f00b48-a3ec-4c39-a70b-02a269319982" returned: 0 in 0.392s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-48f00b48-a3ec-4c39-a70b-02a269319982" released by "delete_volume" :: held 1.139s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['2f561777-92c5-4146-b4dd-8255363c27f3', 'e57abebf-ffa6-4ea5-af47-414687545b37', 'bbcf01cc-df5a-4c76-a7d3-2c02a620e574', '66e67693-3be0-44ec-b7d3-c101587d4380'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['b60c35fa-4ee6-4778-87e1-3e2cec1090dc', 'bd75fd7b-623f-45a9-9592-33612c4571e9', 'f9cdfb19-247a-4dfa-9387-f3bb48b5cf18', '40e6a926-8bce-44f4-9201-d2e848693671'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:57 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:57 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:37:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:57 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:37:57 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:57 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:37:58 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-9f27bb5d-2edb-494a-8532-56e6b42a66b6 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-ed1f3f3a-a56f-4082-8087-fdc5266f9afe-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4624334c-0258-486c-846b-40b2a4aabc10 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-48f00b48-a3ec-4c39-a70b-02a269319982-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-63c15b17-d303-4711-880c-c261024c61a0-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-63c15b17-d303-4711-880c-c261024c61a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-4e08cb12-5286-429f-8764-cc4fa76a972c-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-63c15b17-d303-4711-880c-c261024c61a0" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-63c15b17-d303-4711-880c-c261024c61a0" acquired by "delete_volume" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-4e08cb12-5286-429f-8764-cc4fa76a972c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b94e6-3688-461a-bab3-2c1c850f14c7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "cinder-quobyte-4e08cb12-5286-429f-8764-cc4fa76a972c" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-4e08cb12-5286-429f-8764-cc4fa76a972c" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:37:58 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 Nov 04 22:37:58 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a56a94c-3405-424e-adf8-2aea1ad50e26]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:37:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:59 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c Nov 04 22:37:59 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:59 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0" returned: 0 in 0.751s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:59 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0 Nov 04 22:37:59 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:59 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c" returned: 0 in 0.692s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:37:59 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c Nov 04 22:37:59 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Flow 'volume_create_manager' (05671567-bce7-49cb-b1d7-38a7d6237829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204df096-db55-4fa7-bd01-ddddbb838832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204df096-db55-4fa7-bd01-ddddbb838832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9119cfa-2d72-407a-ada0-d0cd49115fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a198884efcae49ad8f7510f1739fc76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:00Z,use_quota=True,user_id='916eec4736ce4c7c813f856aeda7f67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81759750-35e9-4cdb-adab-caa959b7be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81759750-35e9-4cdb-adab-caa959b7be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6e046-681c-4187-847d-b73f24c3d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.image.glance [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Creating Keystone auth plugin from conf {{(pid=87173) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 22:37:59 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-63c15b17-d303-4711-880c-c261024c61a0" returned: 0 in 0.378s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-63c15b17-d303-4711-880c-c261024c61a0" released by "delete_volume" :: held 1.198s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:37:59 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['abdbd0b3-7bd7-409e-8288-711cb2ef7e48', '0047bf1f-8054-44fe-bdad-a4a2bcce8f42', 'fc2541e3-0e29-4bbf-8c9a-b5543f67431d', '539782d2-1a6f-4061-9317-695efccf1e4b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:00 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4e08cb12-5286-429f-8764-cc4fa76a972c" returned: 0 in 0.403s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-quobyte-4e08cb12-5286-429f-8764-cc4fa76a972c" released by "delete_volume" :: held 1.212s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:00 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:00 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Created reservations ['f5b5b95a-26e0-426a-b98e-3ca3be2fbb2b', '1539a16f-03f9-4a7e-98f0-5e72c7201438', 'ac8fdb94-cb59-4fce-8bf4-6a96140e13bb', 'c1eeda3e-6c7b-436b-bb7d-ebbdd3da68a4'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:00 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:00 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:00 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6e046-681c-4187-847d-b73f24c3d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9119cfa-2d72-407a-ada0-d0cd49115fdd', 'volume_name': 'volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd', 'volume_size': 1, 'image_id': '97882618-828a-4298-9837-0d32391ba56b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a80e5b73f2842f7193aceea3acba51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a198884efcae49ad8f7510f1739fc76a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a3317e3538526254b00e42b465953af84ad47145746456de1d9b273f27ca4e9e216b04c437247cb21761e36369258a3a1487833672f0943254952f53ec6cccf', 'id': '97882618-828a-4298-9837-0d32391ba56b', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97882618-828a-4298-9837-0d32391ba56b/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8d1271-cce0-48cf-a8f6-c78724db41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8d1271-cce0-48cf-a8f6-c78724db41bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b171070-f90c-47fe-9c2d-f9d8b22e273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Volume b9119cfa-2d72-407a-ada0-d0cd49115fdd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd', 'volume_size': 1, 'image_id': '97882618-828a-4298-9837-0d32391ba56b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a80e5b73f2842f7193aceea3acba51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a198884efcae49ad8f7510f1739fc76a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a3317e3538526254b00e42b465953af84ad47145746456de1d9b273f27ca4e9e216b04c437247cb21761e36369258a3a1487833672f0943254952f53ec6cccf', 'id': '97882618-828a-4298-9837-0d32391ba56b', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97882618-828a-4298-9837-0d32391ba56b/file', 'properties': {}}, 'image_service': } Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Trying to clone b9119cfa-2d72-407a-ada0-d0cd49115fdd from image 97882618-828a-4298-9837-0d32391ba56b at location (None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}]). {{(pid=87173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-3709b226-83bd-4dcc-ab6e-b6f3566d98f3 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-63c15b17-d303-4711-880c-c261024c61a0-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 22:38:00 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Image download 0.00 MB at 0.00 MB/s Nov 04 22:38:00 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.320s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Deleted volume successfully. Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-550f4467-adb9-4ce4-bf7d-a57c09a892c0 tempest-CreateVolumesFromSourceVolumeTest-164838916 None] Lock "cinder-4e08cb12-5286-429f-8764-cc4fa76a972c-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e98797-380f-4afa-aa11-23a7bff4d60f]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:00 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:00 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:01 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[03db368c-90f7-4068-bf7e-350435c5e7e7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:01 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:01 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:01 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 Nov 04 22:38:01 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:01 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Temporary image 97882618-828a-4298-9837-0d32391ba56b is fetched for user 916eec4736ce4c7c813f856aeda7f67f. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 22:38:01 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" returned: 0 in 0.430s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:01 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3 Nov 04 22:38:01 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4f03d-aad9-4a85-872b-39176dcd2f1f]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:01 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:01 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:01 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3" released by "delete_volume" :: held 0.843s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:01 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['00b2d609-fd45-42e7-9ff1-6f621a90b366', '6b62a7ab-3e14-4f65-8e0d-9ebb8b0a8096', '807bbcf2-f65d-4a38-9e89-26fa72917c8b', '4dd5fb35-49f0-49f8-81fa-650eca9dba71'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:02 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:02 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:02 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:02 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:02 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-da69e582-b075-4c04-97aa-0f719e4cbc57-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-da69e582-b075-4c04-97aa-0f719e4cbc57-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-da69e582-b075-4c04-97aa-0f719e4cbc57" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-da69e582-b075-4c04-97aa-0f719e4cbc57" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90362a-5d82-4228-a6f8-fae0061d012c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:02 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 1 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9119cfa-2d72-407a-ada0-d0cd49115fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a198884efcae49ad8f7510f1739fc76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:00Z,use_quota=True,user_id='916eec4736ce4c7c813f856aeda7f67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Creating volume b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:02 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:02 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.486s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:02 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:38:02 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1073741824 Nov 04 22:38:02 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6730f506-e3a2-4b49-81b5-b792d8b323ba tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-7a9f59b5-f5b4-4e7d-a689-ab304619d6e3-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:02 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 Nov 04 22:38:02 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Flow 'volume_create_manager' (5701126c-607e-4af5-908f-999338bbebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37930f4a-f86a-48a9-b111-a5ce87da2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37930f4a-f86a-48a9-b111-a5ce87da2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334027273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0d8040-4fc9-4ffd-8e5d-4ce91847434e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58bbb9355264f8299c82af2b5e4cc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:03Z,use_quota=True,user_id='2eb07fed16444ffa8d21b966663e0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af121845-d9b4-4c73-9377-04583d26a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af121845-d9b4-4c73-9377-04583d26a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3268c14-353b-4127-8a3c-78b99c38ad10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3268c14-353b-4127-8a3c-78b99c38ad10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0d8040-4fc9-4ffd-8e5d-4ce91847434e', 'volume_name': 'volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f382fd6-c8b4-497a-b3fb-d6391d9b5af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f382fd6-c8b4-497a-b3fb-d6391d9b5af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0474ad1-4c6b-47a8-a742-95636d0675a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:03 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Volume ee0d8040-4fc9-4ffd-8e5d-4ce91847434e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e', 'volume_size': 1} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:03 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57" returned: 0 in 0.627s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:03 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57 Nov 04 22:38:03 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:03 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1073741824" returned: 0 in 0.672s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:03 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd Nov 04 22:38:03 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:03 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-da69e582-b075-4c04-97aa-0f719e4cbc57" returned: 0 in 0.319s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-da69e582-b075-4c04-97aa-0f719e4cbc57" released by "delete_volume" :: held 1.022s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['bf14930d-8f81-4a99-83c6-cafb79ca9eb9', '26b4113f-b203-468d-bfc5-2b44a3d8eb22', 'ac995491-02f2-4e57-b2bb-698505485bc9', 'eb71c6ee-5747-41c7-ab86-74c7ed7dbbbc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:03 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334027273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0d8040-4fc9-4ffd-8e5d-4ce91847434e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58bbb9355264f8299c82af2b5e4cc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:03Z,use_quota=True,user_id='2eb07fed16444ffa8d21b966663e0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Creating volume ee0d8040-4fc9-4ffd-8e5d-4ce91847434e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:03 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:03 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e 1073741824 Nov 04 22:38:03 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Attempting download of 97882618-828a-4298-9837-0d32391ba56b ((None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}])) to volume b9119cfa-2d72-407a-ada0-d0cd49115fdd. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bfc671-1939-4687-83d4-d98d76c9cdf1]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:03 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:03 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:03 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh Nov 04 22:38:03 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:04 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.367s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-964d6e70-8128-4a1e-981a-2a0d58aadb2c tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-da69e582-b075-4c04-97aa-0f719e4cbc57-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:04 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh" returned: 0 in 0.422s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:04 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e 1073741824" returned: 0 in 0.675s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:04 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh Nov 04 22:38:04 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:04 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e Nov 04 22:38:04 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:04 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh" returned: 1 in 0.375s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97882618-828a-4298-9837-0d32391ba56b_hufu_5qh' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2993048c-1051-4450-a120-219208af167d]: (4, 'raw') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:04 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-a40148ca-b7f7-4b54-bcde-3ddfe6568b77-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0474ad1-4c6b-47a8-a742-95636d0675a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710f59c9-eeb0-48a2-9dd2-b1beb7e62289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-a40148ca-b7f7-4b54-bcde-3ddfe6568b77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:04 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Volume volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e (ee0d8040-4fc9-4ffd-8e5d-4ce91847434e): created successfully Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710f59c9-eeb0-48a2-9dd2-b1beb7e62289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Flow 'volume_create_manager' (5701126c-607e-4af5-908f-999338bbebc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-a40148ca-b7f7-4b54-bcde-3ddfe6568b77" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:04 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4873fb31-8a6c-4c35-b6d8-06bdb1de3383 tempest-ProjectReaderTests-1892690362 None] Created volume successfully. Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-a40148ca-b7f7-4b54-bcde-3ddfe6568b77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:04 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:04 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleting offline snapshot a40148ca-b7f7-4b54-bcde-3ddfe6568b77 of volume 342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] snapshot_file for this snap is: volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef13b20-4142-43e5-a129-9ba5e4a23241]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:04 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 Nov 04 22:38:04 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:04 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:05 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD Nov 04 22:38:05 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:05 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342f29ca-ce98-4728-893d-4e6acf8d9975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc523487-6d6e-47ca-873a-417e33986f4f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:05 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 Nov 04 22:38:05 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:05 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] 97882618-828a-4298-9837-0d32391ba56b was raw, converting to qcow2 {{(pid=87173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:05 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd Nov 04 22:38:05 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Acquiring lock "cinder-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a15be49b-a1eb-42e6-954e-a607b721f32b tempest-ProjectAdminTests-399382938 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5663986206055, 'free_capacity_gb': 1773.5663986206055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87173) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "cinder-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Acquiring lock "cinder-quobyte-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "cinder-quobyte-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5650d8-e3a0-4a6f-b14b-1c879f2c28bf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:05 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975" returned: 0 in 0.494s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:05 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 Nov 04 22:38:05 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:05 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e Nov 04 22:38:05 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:06 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd" returned: 0 in 0.626s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97882618-828a-4298-9837-0d32391ba56b_adx69nk2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:38:06 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:06 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1G Nov 04 22:38:06 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:06 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" returned: 0 in 0.519s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:06 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e Nov 04 22:38:06 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:06 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77" returned: 0 in 0.472s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:06 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77 Nov 04 22:38:06 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:06 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd 1G" returned: 0 in 0.398s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Downloaded image 97882618-828a-4298-9837-0d32391ba56b ((None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}])) to volume b9119cfa-2d72-407a-ada0-d0cd49115fdd successfully. {{(pid=87173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Temporary image 97882618-828a-4298-9837-0d32391ba56b for user 916eec4736ce4c7c813f856aeda7f67f is deleted. {{(pid=87173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.volume_utils [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Marking volume b9119cfa-2d72-407a-ada0-d0cd49115fdd as bootable. {{(pid=87173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Copying metadata from image 97882618-828a-4298-9837-0d32391ba56b to b9119cfa-2d72-407a-ada0-d0cd49115fdd. {{(pid=87173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Creating volume glance metadata for volume b9119cfa-2d72-407a-ada0-d0cd49115fdd backed by image 97882618-828a-4298-9837-0d32391ba56b with: {'image_id': '97882618-828a-4298-9837-0d32391ba56b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f9a80e5b73f2842f7193aceea3acba51', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 22:38:06 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975.a40148ca-b7f7-4b54-bcde-3ddfe6568b77" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "cinder-quobyte-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e" released by "delete_volume" :: held 0.903s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-a40148ca-b7f7-4b54-bcde-3ddfe6568b77" released by "_delete_snapshot" :: held 1.826s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" released by "delete_snapshot" :: held 1.861s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b171070-f90c-47fe-9c2d-f9d8b22e273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd', 'volume_size': 1, 'image_id': '97882618-828a-4298-9837-0d32391ba56b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97882618-828a-4298-9837-0d32391ba56b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a80e5b73f2842f7193aceea3acba51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a198884efcae49ad8f7510f1739fc76a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a3317e3538526254b00e42b465953af84ad47145746456de1d9b273f27ca4e9e216b04c437247cb21761e36369258a3a1487833672f0943254952f53ec6cccf', 'id': '97882618-828a-4298-9837-0d32391ba56b', 'created_at': datetime.datetime(2026, 11, 4, 21, 37, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 21, 37, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97882618-828a-4298-9837-0d32391ba56b/file', 'properties': {}}, 'image_service': }' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a986dd-8746-40d2-a783-c525668a960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:06 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Volume volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd (b9119cfa-2d72-407a-ada0-d0cd49115fdd): created successfully Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a986dd-8746-40d2-a783-c525668a960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Flow 'volume_create_manager' (05671567-bce7-49cb-b1d7-38a7d6237829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-eb3869ea-54f6-4e8d-8442-4d2319d69ea7 tempest-VolumeImageDependencyTests-555026702 None] Created volume successfully. Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Created reservations ['12d71d79-1fe2-4512-85e1-6d1a5471b9fc', 'ecbd3ff1-f2bb-47f0-8d60-981cf2498d33', 'e359fdf2-7a81-4297-8acd-ca4aacd02dcb', '52aaf8da-0835-4113-9507-fd09c473445e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['b2855387-ea10-4014-bbdd-c97e8a815b5c', 'b9695242-6d58-479e-b627-ca4a9e606ed3', '5d09e016-24fa-4acc-a570-c0f8687212ae', 'b74eaba7-8f1a-47cd-ac7c-6e259d395ee3'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:06 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:06 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Delete snapshot completed successfully. Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5a88ae40-ef7b-4e74-9343-7a707ac24e73 tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-a40148ca-b7f7-4b54-bcde-3ddfe6568b77-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-342f29ca-ce98-4728-893d-4e6acf8d9975-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-342f29ca-ce98-4728-893d-4e6acf8d9975-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b441bbc-bd2c-47ee-ac14-0986e6ffebd3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:07 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.303s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Deleted volume successfully. Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a6316ded-0513-48b6-98b9-e31572d3f28b tempest-ProjectReaderTests-1892690362 None] Lock "cinder-ee0d8040-4fc9-4ffd-8e5d-4ce91847434e-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:07 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 Nov 04 22:38:07 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Acquiring lock "cinder-b9119cfa-2d72-407a-ada0-d0cd49115fdd-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "cinder-b9119cfa-2d72-407a-ada0-d0cd49115fdd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Acquiring lock "cinder-quobyte-b9119cfa-2d72-407a-ada0-d0cd49115fdd" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "cinder-quobyte-b9119cfa-2d72-407a-ada0-d0cd49115fdd" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd63eb-07ea-4dca-ba2b-81a6a0adb1c3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:07 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:07 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975 Nov 04 22:38:07 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:07 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd Nov 04 22:38:07 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:07 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-342f29ca-ce98-4728-893d-4e6acf8d9975" returned: 0 in 0.279s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-quobyte-342f29ca-ce98-4728-893d-4e6acf8d9975" released by "delete_volume" :: held 0.795s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Created reservations ['432a446e-26d6-423e-9738-15963d422886', 'beaa18ad-cfca-49b5-acfc-507676af97ca', '7055e0db-4417-452c-88f7-8941661d017d', 'f3f856c7-c213-4208-bcf5-cc043a4c43fd'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:07 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd" returned: 0 in 0.456s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:07 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd Nov 04 22:38:07 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:07 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:07 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:08 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-b9119cfa-2d72-407a-ada0-d0cd49115fdd" returned: 0 in 0.405s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "cinder-quobyte-b9119cfa-2d72-407a-ada0-d0cd49115fdd" released by "delete_volume" :: held 0.936s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:08 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.412s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Deleted volume successfully. Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Created reservations ['4541b9f2-9931-48d5-8bd4-99966ec832dc', '3059eafa-0875-43df-87fe-3020b008874a', '2255e409-8389-4363-a610-16154ace1ffd', '091ae650-6159-43ea-8001-71f048ebcf64'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8ce79603-08a4-4add-9a0d-e9aa7fbfc35a tempest-CreateVolumesFromSnapshotTest-91674303 None] Lock "cinder-342f29ca-ce98-4728-893d-4e6acf8d9975-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Flow 'volume_create_manager' (a424f215-7343-4960-97f9-c0854917d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1e2aa7-c513-4622-9f7f-952f02f5aa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:08 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:08 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1e2aa7-c513-4622-9f7f-952f02f5aa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827114910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e13aa1b-a328-4f2f-b9a2-8020a941c71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58bbb9355264f8299c82af2b5e4cc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:08Z,use_quota=True,user_id='2eb07fed16444ffa8d21b966663e0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b04f90c-5fa4-495c-b2e1-374623704a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b04f90c-5fa4-495c-b2e1-374623704a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f128ae6b-5f6a-48d9-95fc-7dc8948a6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f128ae6b-5f6a-48d9-95fc-7dc8948a6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e13aa1b-a328-4f2f-b9a2-8020a941c71d', 'volume_name': 'volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71248bd-bc13-40f9-8262-d28ed55796c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71248bd-bc13-40f9-8262-d28ed55796c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e3f627-a272-4586-bfe5-e46ac0c2e244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:08 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Volume 9e13aa1b-a328-4f2f-b9a2-8020a941c71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d', 'volume_size': 1} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827114910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e13aa1b-a328-4f2f-b9a2-8020a941c71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58bbb9355264f8299c82af2b5e4cc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:08Z,use_quota=True,user_id='2eb07fed16444ffa8d21b966663e0d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Creating volume 9e13aa1b-a328-4f2f-b9a2-8020a941c71d {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:08 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:08 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d 1073741824 Nov 04 22:38:08 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:09 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.442s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Deleted volume successfully. Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6ab54714-5757-4fed-8ed1-28bb34a77292 tempest-VolumeImageDependencyTests-555026702 None] Lock "cinder-b9119cfa-2d72-407a-ada0-d0cd49115fdd-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:09 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d 1073741824" returned: 0 in 0.668s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:09 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d Nov 04 22:38:09 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:09 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e3f627-a272-4586-bfe5-e46ac0c2e244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348493eb-17aa-4f19-87c0-a92b264bd13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Volume volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d (9e13aa1b-a328-4f2f-b9a2-8020a941c71d): created successfully Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348493eb-17aa-4f19-87c0-a92b264bd13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Flow 'volume_create_manager' (a424f215-7343-4960-97f9-c0854917d02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-74fde621-b892-4f0f-86e4-c3c566e363da tempest-ProjectReaderTests-1892690362 None] Created volume successfully. Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Acquiring lock "cinder-9e13aa1b-a328-4f2f-b9a2-8020a941c71d-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "cinder-9e13aa1b-a328-4f2f-b9a2-8020a941c71d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Acquiring lock "cinder-quobyte-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "cinder-quobyte-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e034a972-3f91-4e1a-95d8-9ed4d4033347]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:10 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d Nov 04 22:38:10 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:11 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" returned: 0 in 0.507s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:11 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d Nov 04 22:38:11 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:11 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" returned: 0 in 0.276s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "cinder-quobyte-9e13aa1b-a328-4f2f-b9a2-8020a941c71d" released by "delete_volume" :: held 0.848s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Created reservations ['c4281696-7fca-4692-87c0-f1fa47cf14e9', 'ed29d5bd-2b21-4ddc-ab24-b4ddbdb93730', '5c723650-abce-4767-82fe-17954a3a9262', '53856159-09c3-4c91-8dcb-b467d25c742e'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:11 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:11 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:11 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.267s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Deleted volume successfully. Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-60f89cd2-bf28-44b4-87b7-f4e33a5547fc tempest-ProjectReaderTests-1892690362 None] Lock "cinder-9e13aa1b-a328-4f2f-b9a2-8020a941c71d-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Flow 'volume_create_manager' (2d473cb2-a1ef-4b3a-829b-a59e01115d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0735c14c-34e9-40d9-956c-90469fa0a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0735c14c-34e9-40d9-956c-90469fa0a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1100164341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbe44ac-6cde-49d5-afbb-77d4fa05d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9e100042eab297b5858c8e6aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:12Z,use_quota=True,user_id='ab7e53979fe7474282f7c6bf7ce0e94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0ba32d-8c7e-4802-954d-db0b2383d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0ba32d-8c7e-4802-954d-db0b2383d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b6ba1-2b7e-4322-afb6-de94c8b56b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b6ba1-2b7e-4322-afb6-de94c8b56b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbe44ac-6cde-49d5-afbb-77d4fa05d88f', 'volume_name': 'volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d6ba1e-fc89-49f1-ac10-2397dc3acb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d6ba1e-fc89-49f1-ac10-2397dc3acb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a502ce5-dbb1-4c30-bcb3-3f838b6f9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:12 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Volume bcbe44ac-6cde-49d5-afbb-77d4fa05d88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f', 'volume_size': 1} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1100164341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbe44ac-6cde-49d5-afbb-77d4fa05d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9e100042eab297b5858c8e6aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:12Z,use_quota=True,user_id='ab7e53979fe7474282f7c6bf7ce0e94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Creating volume bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:12 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:12 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f 1073741824 Nov 04 22:38:12 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:13 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f 1073741824" returned: 0 in 0.590s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:13 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:13 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:13 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.308s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a502ce5-dbb1-4c30-bcb3-3f838b6f9389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a4a79b-ea2c-4656-8798-7d62875b0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:13 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Volume volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f (bcbe44ac-6cde-49d5-afbb-77d4fa05d88f): created successfully Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a4a79b-ea2c-4656-8798-7d62875b0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:13 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Flow 'volume_create_manager' (2d473cb2-a1ef-4b3a-829b-a59e01115d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4bdafd26-1583-459d-8abe-25de580e607c tempest-VolumeDependencyTests-1950043029 None] Created volume successfully. Nov 04 22:38:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Creating offline snapshot d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 of volume bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:14 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dade85d-5fd8-45d6-ad3e-16fcf37d8e11]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:14 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:14 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:15 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.458s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:15 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 1G Nov 04 22:38:15 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:15 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 1G" returned: 0 in 0.604s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:15 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:15 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:16 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.345s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:16 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 is being set with open permissions: ugo+rw Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:16 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:16 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:16 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.307s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:16 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info Nov 04 22:38:16 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:16 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info" returned: 0 in 0.313s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:16 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info is being set with open permissions: ugo+rw Nov 04 22:38:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:16 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info Nov 04 22:38:16 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:17 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.info" returned: 0 in 0.347s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0c31122b-0782-4195-9be1-567cea7ed395 tempest-VolumeDependencyTests-1950043029 None] Create snapshot completed successfully Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Flow 'volume_create_manager' (73fbdd0a-7cc7-4b59-a157-659d3e588630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99af7a-8b3e-4df4-8977-1dd860da5f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99af7a-8b3e-4df4-8977-1dd860da5f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-341353857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b281fb-22d7-4029-b5c5-afcffb15b966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9e100042eab297b5858c8e6aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:19Z,use_quota=True,user_id='ab7e53979fe7474282f7c6bf7ce0e94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a308e3cc-3eaa-441a-a319-c5d5dacad494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a308e3cc-3eaa-441a-a319-c5d5dacad494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38950d71-1684-40e8-8011-0c51ed5a94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38950d71-1684-40e8-8011-0c51ed5a94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e2b281fb-22d7-4029-b5c5-afcffb15b966', 'volume_name': 'volume-e2b281fb-22d7-4029-b5c5-afcffb15b966', 'volume_size': 1, 'snapshot_id': 'd09cc18a-2c8e-4731-9cc1-c00d1a8f5c45'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5db07a0-46f5-4328-9f5f-a71bd03ef2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5db07a0-46f5-4328-9f5f-a71bd03ef2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fee00ca-3c9e-479a-a4db-c67108c48790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:18 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Volume e2b281fb-22d7-4029-b5c5-afcffb15b966: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e2b281fb-22d7-4029-b5c5-afcffb15b966', 'volume_size': 1, 'snapshot_id': 'd09cc18a-2c8e-4731-9cc1-c00d1a8f5c45'} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-e2b281fb-22d7-4029-b5c5-afcffb15b966" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-e2b281fb-22d7-4029-b5c5-afcffb15b966" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Creating volume e2b281fb-22d7-4029-b5c5-afcffb15b966 from snapshot d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] snapshot: d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45, volume: e2b281fb-22d7-4029-b5c5-afcffb15b966, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06d9c3-0c71-432a-a536-ef7d0c006c37]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:19 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:19 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:19 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.501s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:19 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[071509ef-f274-41dc-aa2b-ad9500120ca9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:19 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:19 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:20 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.617s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:20 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 Nov 04 22:38:20 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (b2b23d39-8715-45aa-b079-f342801e9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bdb7ff-5e62-4214-970b-46ca73cc0921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bdb7ff-5e62-4214-970b-46ca73cc0921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106967190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66602e33-79eb-49df-bf61-6d554f3bdaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:20Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bb313b-afd8-4a66-bd0e-6fe10fe1ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bb313b-afd8-4a66-bd0e-6fe10fe1ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77fd57c-2473-48f4-8f64-7fc5e37872f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77fd57c-2473-48f4-8f64-7fc5e37872f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66602e33-79eb-49df-bf61-6d554f3bdaaf', 'volume_name': 'volume-66602e33-79eb-49df-bf61-6d554f3bdaaf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ceff15-23b8-4464-ba2a-842ab197ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ceff15-23b8-4464-ba2a-842ab197ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e1ae13-7135-4e5b-8a3e-10ee80cd8fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:20 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Volume 66602e33-79eb-49df-bf61-6d554f3bdaaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66602e33-79eb-49df-bf61-6d554f3bdaaf', 'volume_size': 1} Nov 04 22:38:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:28 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966" returned: 0 in 8.217s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:38:28 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Converted 1024.00 MB image at 124.61 MB/s Nov 04 22:38:28 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 is being set with open permissions: ugo+rw Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:28 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 Nov 04 22:38:28 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:28 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966" returned: 0 in 0.274s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" released by "_copy_volume_from_snapshot" :: held 9.752s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=180,cinder:UPDATE=236,cinder:INSERT=62,cinder:DELETE=22 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=259,cinder:SELECT=174,cinder:INSERT=69,cinder:DELETE=23 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-e2b281fb-22d7-4029-b5c5-afcffb15b966" released by "_create_volume_from_snapshot" :: held 9.865s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.890s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.341s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106967190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66602e33-79eb-49df-bf61-6d554f3bdaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:20Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Creating volume 66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:28 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:28 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf 1073741824 Nov 04 22:38:28 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fee00ca-3c9e-479a-a4db-c67108c48790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b281fb-22d7-4029-b5c5-afcffb15b966', 'volume_size': 1, 'snapshot_id': 'd09cc18a-2c8e-4731-9cc1-c00d1a8f5c45'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b822d-c8f8-41f7-b4ff-7a7935e45311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:28 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Volume volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 (e2b281fb-22d7-4029-b5c5-afcffb15b966): created successfully Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b822d-c8f8-41f7-b4ff-7a7935e45311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:28 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Flow 'volume_create_manager' (73fbdd0a-7cc7-4b59-a157-659d3e588630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6904bbd1-f788-4837-9c9b-ff2990974da9 tempest-VolumeDependencyTests-1950043029 None] Created volume successfully. Nov 04 22:38:29 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf 1073741824" returned: 0 in 0.525s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:29 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf Nov 04 22:38:29 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:29 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf" returned: 0 in 0.293s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e1ae13-7135-4e5b-8a3e-10ee80cd8fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66602e33-79eb-49df-bf61-6d554f3bdaaf', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e879dae1-3121-4bc8-b035-bf87f541c547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:29 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Volume volume-66602e33-79eb-49df-bf61-6d554f3bdaaf (66602e33-79eb-49df-bf61-6d554f3bdaaf): created successfully Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e879dae1-3121-4bc8-b035-bf87f541c547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (b2b23d39-8715-45aa-b079-f342801e9e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:29 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3cb72794-dd08-4930-85cc-3182defdfd14 tempest-ProjectReaderTests-121437089 None] Created volume successfully. Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Deleting offline snapshot d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 of volume bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] snapshot_file for this snap is: volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbce49-a8df-4432-99c4-193630c29c27]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:30 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:30 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:30 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.412s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff28d17-355d-473e-897a-438e7dc16463]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Creating offline snapshot 91cebec3-cf7e-4afc-9636-9e1a20d72d20 of volume 66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4139aa34-87e6-4a79-ad3f-b2ed8848d89a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:30 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:30 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:30 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf Nov 04 22:38:30 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:30 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:30 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 1G Nov 04 22:38:30 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:31 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.640s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:31 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:31 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:31 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 1G" returned: 0 in 0.469s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66602e33-79eb-49df-bf61-6d554f3bdaaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:31 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66602e33-79eb-49df-bf61-6d554f3bdaaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 Nov 04 22:38:31 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:31 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.404s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:31 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45 Nov 04 22:38:31 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:31 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66602e33-79eb-49df-bf61-6d554f3bdaaf -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:31 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 is being set with open permissions: ugo+rw Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:31 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f.d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" returned: 0 in 0.304s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:31 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 Nov 04 22:38:31 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45" released by "_delete_snapshot" :: held 1.901s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" released by "delete_snapshot" :: held 1.933s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Created reservations ['e3cf0596-343f-4c3f-874f-51483ea7eb03', 'b55a7a14-38ee-430d-b8ad-4aba484cef0e', '7eb2326a-a169-44c1-b93b-5fefac28f508', '794d8674-5c6f-479a-8531-08a83e426c16'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Delete snapshot completed successfully. Nov 04 22:38:31 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8dda42dd-90f2-48aa-b844-13564ce6fd38 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-d09cc18a-2c8e-4731-9cc1-c00d1a8f5c45-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:32 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:32 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:32 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa8747-45c0-4045-9ee9-c34c127eaa60]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:32 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:32 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:32 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:32 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info is being set with open permissions: ugo+rw Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:32 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info Nov 04 22:38:32 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:32 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:32 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.info" returned: 0 in 0.299s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.510s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:32 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f Nov 04 22:38:32 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:32 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-c310f11b-a913-4e0a-933d-5e71a8707c22 tempest-ProjectReaderTests-121437089 None] Create snapshot completed successfully Nov 04 22:38:32 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:32 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f" released by "delete_volume" :: held 0.871s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Created reservations ['62333079-fb40-445c-9ae5-0706cc7b624e', '81ce1bd6-1108-4fbd-a30d-1eccb6a9ab00', 'aca577c9-23ce-4adb-af1f-63256ec93b69', '6b753366-8d08-4118-be4b-ab1b631e398b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:33 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:33 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-e2b281fb-22d7-4029-b5c5-afcffb15b966-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-e2b281fb-22d7-4029-b5c5-afcffb15b966-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd335e-8549-41e3-8c53-06fa45148321]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:33 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.287s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:33 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Deleted volume successfully. Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0087eb6d-61d8-4cab-827a-039b8750ae78 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-bcbe44ac-6cde-49d5-afbb-77d4fa05d88f-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:33 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 Nov 04 22:38:33 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:33 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966" returned: 0 in 0.448s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:33 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966 Nov 04 22:38:33 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-91cebec3-cf7e-4afc-9636-9e1a20d72d20-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-91cebec3-cf7e-4afc-9636-9e1a20d72d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-91cebec3-cf7e-4afc-9636-9e1a20d72d20" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-91cebec3-cf7e-4afc-9636-9e1a20d72d20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Deleting offline snapshot 91cebec3-cf7e-4afc-9636-9e1a20d72d20 of volume 66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] snapshot_file for this snap is: volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268970a-28a6-4788-a1b8-b257fda4125f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:34 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-e2b281fb-22d7-4029-b5c5-afcffb15b966" returned: 0 in 0.317s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-quobyte-e2b281fb-22d7-4029-b5c5-afcffb15b966" released by "delete_volume" :: held 0.827s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:34 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 Nov 04 22:38:34 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Created reservations ['8118d354-0809-489b-b39a-c5057373e2ff', '9b84058d-5653-4595-ab7f-9b8b2f9710ff', '979087e1-12cc-48d9-8201-8df2456b0ddb', '51534058-c6f2-4877-afd5-f13533eb8098'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:34 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:34 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:34 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20" returned: 0 in 0.414s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66602e33-79eb-49df-bf61-6d554f3bdaaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b69687-1905-426b-be47-0d26450bbff3]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:34 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.291s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Deleted volume successfully. Nov 04 22:38:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-15b3ab2f-a11c-4263-a318-a69f876264f3 tempest-VolumeDependencyTests-1950043029 None] Lock "cinder-e2b281fb-22d7-4029-b5c5-afcffb15b966-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:34 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf Nov 04 22:38:34 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:35 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf" returned: 0 in 0.528s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:35 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 Nov 04 22:38:35 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:35 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20" returned: 0 in 0.408s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:35 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20 Nov 04 22:38:35 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:35 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf.91cebec3-cf7e-4afc-9636-9e1a20d72d20" returned: 0 in 0.284s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-91cebec3-cf7e-4afc-9636-9e1a20d72d20" released by "_delete_snapshot" :: held 1.776s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" released by "delete_snapshot" :: held 1.810s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Created reservations ['05fb5e97-2646-4e0b-abf7-cdb571d24f55', '586e0523-2246-4836-aff8-1101a76f1e8f', '844ee661-2b14-4ec4-b8b9-2f43d89064e9', '4acc9b35-94c2-409c-a37b-cbbbbf93c358'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Delete snapshot completed successfully. Nov 04 22:38:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d7cc38d7-03e2-40ed-b2c7-8045c800eddd tempest-ProjectReaderTests-121437089 None] Lock "cinder-91cebec3-cf7e-4afc-9636-9e1a20d72d20-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-66602e33-79eb-49df-bf61-6d554f3bdaaf-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "cinder-66602e33-79eb-49df-bf61-6d554f3bdaaf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d71dd9-f1d4-4487-9618-90578d566838]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:36 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf Nov 04 22:38:36 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:36 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf" returned: 0 in 0.572s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:36 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf Nov 04 22:38:36 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:37 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-66602e33-79eb-49df-bf61-6d554f3bdaaf" returned: 0 in 0.358s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-66602e33-79eb-49df-bf61-6d554f3bdaaf" released by "delete_volume" :: held 1.026s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Created reservations ['f2525f85-89ec-449a-b7e7-9372a367722b', 'c91e26bc-6852-4291-b305-bee17219cc35', '21281d07-eeea-4f3a-8e2a-845f05bb192d', '3ac5e7c8-22e5-40a4-9a4d-8325aae85ec1'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:37 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:37 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:37 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.330s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Deleted volume successfully. Nov 04 22:38:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-215a7d21-c24c-4599-8a4a-d16504383d87 tempest-ProjectReaderTests-121437089 None] Lock "cinder-66602e33-79eb-49df-bf61-6d554f3bdaaf-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Flow 'volume_create_manager' (de12bc9d-0ab1-46ed-b0ed-3a5852b46d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651a5bfb-5c4c-418a-9c67-5627b3b658cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651a5bfb-5c4c-418a-9c67-5627b3b658cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f563a3c5-85b5-4274-b2b6-cdbe1d41fabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a4699318c4caa947eaf8c28c05b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:38Z,use_quota=True,user_id='50f55ffd21924695b61ec4aecd82974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53519a51-a725-4180-865e-de44eacdd12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53519a51-a725-4180-865e-de44eacdd12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2fcfae-a8f5-4c86-bd89-e3de6563c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2fcfae-a8f5-4c86-bd89-e3de6563c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f563a3c5-85b5-4274-b2b6-cdbe1d41fabe', 'volume_name': 'volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c393f0-08f7-4a2c-bb7a-f58888add09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c393f0-08f7-4a2c-bb7a-f58888add09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f39d4-3590-4ba1-bedf-e724d81e6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Volume f563a3c5-85b5-4274-b2b6-cdbe1d41fabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe', 'volume_size': 1} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f563a3c5-85b5-4274-b2b6-cdbe1d41fabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a4699318c4caa947eaf8c28c05b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:38Z,use_quota=True,user_id='50f55ffd21924695b61ec4aecd82974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Creating volume f563a3c5-85b5-4274-b2b6-cdbe1d41fabe {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:38 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:38 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe 1073741824 Nov 04 22:38:38 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:38 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe 1073741824" returned: 0 in 0.596s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:39 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe Nov 04 22:38:39 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (8f60e322-35b4-4622-a43b-64c584d9b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3f0bd0-d941-4f67-97eb-fbf76426c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3f0bd0-d941-4f67-97eb-fbf76426c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531011015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32278098-fbf4-4346-b63d-2d171db190b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:39Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343794dd-6ead-45b5-8d25-16fac701e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343794dd-6ead-45b5-8d25-16fac701e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb31a3-783a-4634-a2dc-b69275b5145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb31a3-783a-4634-a2dc-b69275b5145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32278098-fbf4-4346-b63d-2d171db190b1', 'volume_name': 'volume-32278098-fbf4-4346-b63d-2d171db190b1', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bbc427-847e-4b86-aa3b-2571b31ce6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bbc427-847e-4b86-aa3b-2571b31ce6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb0b034-d6ab-4c46-81cc-f48fe1b20bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Volume 32278098-fbf4-4346-b63d-2d171db190b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32278098-fbf4-4346-b63d-2d171db190b1', 'volume_size': 1} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:39 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" returned: 0 in 0.321s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531011015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32278098-fbf4-4346-b63d-2d171db190b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:39Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Creating volume 32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:39 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f39d4-3590-4ba1-bedf-e724d81e6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba61fb-53a2-4fe5-877e-4d267ecef12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:39 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 1073741824 Nov 04 22:38:39 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Volume volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe (f563a3c5-85b5-4274-b2b6-cdbe1d41fabe): created successfully Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba61fb-53a2-4fe5-877e-4d267ecef12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Flow 'volume_create_manager' (de12bc9d-0ab1-46ed-b0ed-3a5852b46d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:39 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a9e98cfa-57b5-4b4d-a4be-539e62b5905c tempest-CinderUnicodeTest-1417183638 None] Created volume successfully. Nov 04 22:38:39 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 1073741824" returned: 0 in 0.534s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:39 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 Nov 04 22:38:39 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:40 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb0b034-d6ab-4c46-81cc-f48fe1b20bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32278098-fbf4-4346-b63d-2d171db190b1', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8faaaa-b59a-4470-be3c-a915815ff52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Volume volume-32278098-fbf4-4346-b63d-2d171db190b1 (32278098-fbf4-4346-b63d-2d171db190b1): created successfully Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8faaaa-b59a-4470-be3c-a915815ff52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (8f60e322-35b4-4622-a43b-64c584d9b88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-91d0ebcf-9315-4870-9941-59bd793d5072 tempest-ProjectReaderTests-121437089 None] Created volume successfully. Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Flow 'volume_create_manager' (67992e51-0c4f-4860-a887-95bd52298ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ffaeb0-8244-44ea-bb83-9cda59d36caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ffaeb0-8244-44ea-bb83-9cda59d36caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1253159288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f56942f-7ef0-4fcf-8c62-dcd109f3fc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a4699318c4caa947eaf8c28c05b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:41Z,use_quota=True,user_id='50f55ffd21924695b61ec4aecd82974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e012cee-285f-4d4b-a7b3-f4db67185693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e012cee-285f-4d4b-a7b3-f4db67185693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a03a3d0-63a2-4b4b-96f2-868eefaef6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a03a3d0-63a2-4b4b-96f2-868eefaef6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f56942f-7ef0-4fcf-8c62-dcd109f3fc89', 'volume_name': 'volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb41b049-bfc1-4209-a6ed-2d1a2d0db922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb41b049-bfc1-4209-a6ed-2d1a2d0db922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe8728-eaee-4709-bb5d-aa03a58dd28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:41 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Volume 9f56942f-7ef0-4fcf-8c62-dcd109f3fc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89', 'volume_size': 1} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1253159288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f56942f-7ef0-4fcf-8c62-dcd109f3fc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a4699318c4caa947eaf8c28c05b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:41Z,use_quota=True,user_id='50f55ffd21924695b61ec4aecd82974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Creating volume 9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:41 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:41 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 1073741824 Nov 04 22:38:41 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:41 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 1073741824" returned: 0 in 0.499s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:41 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 Nov 04 22:38:41 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:41 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" returned: 0 in 0.292s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.604s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe8728-eaee-4709-bb5d-aa03a58dd28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de23eb44-dee7-4721-acaf-407275592152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Creating offline snapshot 279da570-08b1-4ab6-a939-4808f2088425 of volume 32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:42 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Volume volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 (9f56942f-7ef0-4fcf-8c62-dcd109f3fc89): created successfully Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de23eb44-dee7-4721-acaf-407275592152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Flow 'volume_create_manager' (67992e51-0c4f-4860-a887-95bd52298ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d412c-53f5-49d8-9f6d-e99cec573ddf]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:42 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-3a0ee2e8-5ff6-4c0f-a930-1c377846be35 tempest-CinderUnicodeTest-1417183638 None] Created volume successfully. Nov 04 22:38:42 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 Nov 04 22:38:42 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:42 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1" returned: 0 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:42 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 1G Nov 04 22:38:42 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:42 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 1G" returned: 0 in 0.481s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32278098-fbf4-4346-b63d-2d171db190b1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:42 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32278098-fbf4-4346-b63d-2d171db190b1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 Nov 04 22:38:42 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:43 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32278098-fbf4-4346-b63d-2d171db190b1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425" returned: 0 in 0.332s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:43 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 is being set with open permissions: ugo+rw Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:43 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 Nov 04 22:38:43 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:43 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:43 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info Nov 04 22:38:43 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:43 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:43 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info is being set with open permissions: ugo+rw Nov 04 22:38:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:43 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info Nov 04 22:38:43 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:44 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.info" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Creating offline snapshot 4f739f98-f4e2-42a4-8ae5-04b085cf24b8 of volume 9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-dc5eddf8-76c2-43fd-8632-19abebb8c63c tempest-ProjectReaderTests-121437089 None] Create snapshot completed successfully Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388548c-d452-4081-a18c-73f336a29236]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:44 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 Nov 04 22:38:44 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:44 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-279da570-08b1-4ab6-a939-4808f2088425-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" returned: 0 in 0.412s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-279da570-08b1-4ab6-a939-4808f2088425-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:44 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 1G Nov 04 22:38:44 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-279da570-08b1-4ab6-a939-4808f2088425" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-279da570-08b1-4ab6-a939-4808f2088425" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Deleting offline snapshot 279da570-08b1-4ab6-a939-4808f2088425 of volume 32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] snapshot_file for this snap is: volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb965523-c70e-4737-9879-bff9b1388592]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:44 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 Nov 04 22:38:44 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:45 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 1G" returned: 0 in 0.641s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:45 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425" returned: 0 in 0.515s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32278098-fbf4-4346-b63d-2d171db190b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:45 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 Nov 04 22:38:45 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6498b2-c31d-4655-8da2-d3d06805ab98]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:45 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 Nov 04 22:38:45 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:45 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8" returned: 0 in 0.322s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:45 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 is being set with open permissions: ugo+rw Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:45 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 Nov 04 22:38:45 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:45 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1" returned: 0 in 0.424s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:45 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 Nov 04 22:38:45 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:45 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:45 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info Nov 04 22:38:45 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:46 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425" returned: 0 in 0.386s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:46 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425 Nov 04 22:38:46 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:46 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info" returned: 0 in 0.296s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:46 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info is being set with open permissions: ugo+rw Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:46 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info Nov 04 22:38:46 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:46 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1.279da570-08b1-4ab6-a939-4808f2088425" returned: 0 in 0.271s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-279da570-08b1-4ab6-a939-4808f2088425" released by "_delete_snapshot" :: held 1.738s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" released by "delete_snapshot" :: held 1.768s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:46 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.info" returned: 0 in 0.265s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ed9bce4e-67a3-4749-a4e9-81c5d9831f0c tempest-CinderUnicodeTest-1417183638 None] Create snapshot completed successfully Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Created reservations ['cbb50e4d-c380-4f84-b6c0-c1911c02b70e', '13a26151-b1ed-49dd-83b4-a91f5a721bed', '777ef61b-24c7-4c43-b358-9c2389a67eba', 'd7d8266f-1cd5-4fda-a839-809ab6fcb974'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Delete snapshot completed successfully. Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-ea3883b7-d784-4968-b7e1-a4926aae9018 tempest-ProjectReaderTests-121437089 None] Lock "cinder-279da570-08b1-4ab6-a939-4808f2088425-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-32278098-fbf4-4346-b63d-2d171db190b1-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "cinder-32278098-fbf4-4346-b63d-2d171db190b1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8dd289-0565-4466-a5b0-feddeef390de]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:47 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 Nov 04 22:38:47 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:47 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:47 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1 Nov 04 22:38:47 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:47 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-32278098-fbf4-4346-b63d-2d171db190b1" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-4f739f98-f4e2-42a4-8ae5-04b085cf24b8-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-32278098-fbf4-4346-b63d-2d171db190b1" released by "delete_volume" :: held 0.776s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-4f739f98-f4e2-42a4-8ae5-04b085cf24b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-quobyte-4f739f98-f4e2-42a4-8ae5-04b085cf24b8" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-4f739f98-f4e2-42a4-8ae5-04b085cf24b8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Deleting offline snapshot 4f739f98-f4e2-42a4-8ae5-04b085cf24b8 of volume 9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] snapshot_file for this snap is: volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d550c5-6637-4267-975c-35bfec245b9c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Created reservations ['4a8be087-efbe-4e33-8d0f-32c4573260f6', '1d003842-6140-4fc6-b413-d67db16d7904', 'c91804dc-0e97-4416-8fe8-80d101e9439f', '6488da7f-5c2b-42dc-b26a-a8640149e353'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:47 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 Nov 04 22:38:47 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:48 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:48 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:48 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.265s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Deleted volume successfully. Nov 04 22:38:48 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8" returned: 0 in 0.476s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b2280a31-371a-423c-acac-d57a40a6af3c tempest-ProjectReaderTests-121437089 None] Lock "cinder-32278098-fbf4-4346-b63d-2d171db190b1-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a71f5a-4b85-4319-a5fe-d6316d2498d1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:48 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 Nov 04 22:38:48 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:48 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" returned: 0 in 0.384s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:48 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 Nov 04 22:38:48 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:49 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:49 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8 Nov 04 22:38:49 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:49 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89.4f739f98-f4e2-42a4-8ae5-04b085cf24b8" returned: 0 in 0.336s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-4f739f98-f4e2-42a4-8ae5-04b085cf24b8" released by "_delete_snapshot" :: held 1.769s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" released by "delete_snapshot" :: held 1.810s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Created reservations ['4d2f982f-27f2-4767-99c2-3abed5293e21', 'b7a8abbf-628d-447e-9e7f-0af663d33214', '12ff37ef-d548-435a-9167-e28634ae245c', '4b29b577-566f-42f1-9bb3-114a11ae48a5'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:49 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Delete snapshot completed successfully. Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7fb7c001-cafc-48ee-8ff3-6188d6e7ddeb tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-4f739f98-f4e2-42a4-8ae5-04b085cf24b8-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (3dec3dad-bbef-4cbe-a532-5388a4b7bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d3207a-a7f2-4be2-b589-283eba9909a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d3207a-a7f2-4be2-b589-283eba9909a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054375884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead62c49-42b1-4d10-8823-a21cd70f55fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:50Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818a1eba-182f-4022-b7fb-68f4410c855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818a1eba-182f-4022-b7fb-68f4410c855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd655b-4c5e-4814-b700-4e2879ee629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd655b-4c5e-4814-b700-4e2879ee629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead62c49-42b1-4d10-8823-a21cd70f55fc', 'volume_name': 'volume-ead62c49-42b1-4d10-8823-a21cd70f55fc', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a4ecb-b982-4a97-887c-6b4f15e79abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a4ecb-b982-4a97-887c-6b4f15e79abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca819221-323a-4d93-b3c9-5618cf65a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:49 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Volume ead62c49-42b1-4d10-8823-a21cd70f55fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead62c49-42b1-4d10-8823-a21cd70f55fc', 'volume_size': 1} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054375884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead62c49-42b1-4d10-8823-a21cd70f55fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:50Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Creating volume ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:49 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:49 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc 1073741824 Nov 04 22:38:49 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435d557-ff4b-4062-96bb-60b881645939]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:50 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 Nov 04 22:38:50 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:50 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc 1073741824" returned: 0 in 0.527s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:50 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc Nov 04 22:38:50 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:50 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" returned: 0 in 0.443s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:50 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89 Nov 04 22:38:50 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:50 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc" returned: 0 in 0.314s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca819221-323a-4d93-b3c9-5618cf65a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead62c49-42b1-4d10-8823-a21cd70f55fc', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f812ef8-f90a-4fe2-9f85-fb06c106a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:50 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Volume volume-ead62c49-42b1-4d10-8823-a21cd70f55fc (ead62c49-42b1-4d10-8823-a21cd70f55fc): created successfully Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f812ef8-f90a-4fe2-9f85-fb06c106a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (3dec3dad-bbef-4cbe-a532-5388a4b7bc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:50 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7cf5a20d-a6fd-49c3-ab39-4f5e50a3b2c8 tempest-ProjectReaderTests-121437089 None] Created volume successfully. Nov 04 22:38:50 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89" released by "delete_volume" :: held 0.859s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Created reservations ['6422e196-2f2d-4722-b7d6-20118e8cdc9f', '4c1ac975-6e20-4364-a711-3a1e32664d5c', '741192d3-0218-4a14-a1a7-f2fa4fa32d7f', '64f48843-b854-473e-bdfd-924cb1fcbdfb'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:50 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:50 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "cinder-quobyte-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c086bf6-dfb9-4a52-b7e8-0fb780b8e7a9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:51 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Deleted volume successfully. Nov 04 22:38:51 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe Nov 04 22:38:51 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b60d7406-1873-4b27-a557-a07824697b59 tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-9f56942f-7ef0-4fcf-8c62-dcd109f3fc89-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:51 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:51 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe Nov 04 22:38:51 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:51 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-quobyte-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe" released by "delete_volume" :: held 0.757s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:51 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Created reservations ['6362759b-86fb-4f47-8b7c-fa8ff1f4076b', '6fbde411-27eb-49bf-be2c-61d7e7cf39c9', '72bde1f7-736a-4060-a6ce-01a06853820d', 'ae1b768a-9008-436e-bf20-1e70bc90fb24'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Creating offline snapshot af0ef80e-b505-40b8-98a4-cbd055439b2a of volume ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38efede-cf1a-4950-a470-96b5292715ba]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:52 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:52 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:52 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc Nov 04 22:38:52 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:52 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.316s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:52 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Deleted volume successfully. Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e28e3a78-ff24-4d66-8ce7-283f2399a60a tempest-CinderUnicodeTest-1417183638 None] Lock "cinder-f563a3c5-85b5-4274-b2b6-cdbe1d41fabe-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:52 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc" returned: 0 in 0.493s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:52 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a 1G Nov 04 22:38:52 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:53 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a 1G" returned: 0 in 0.640s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead62c49-42b1-4d10-8823-a21cd70f55fc -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:53 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead62c49-42b1-4d10-8823-a21cd70f55fc -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a Nov 04 22:38:53 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:53 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ead62c49-42b1-4d10-8823-a21cd70f55fc -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:53 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a is being set with open permissions: ugo+rw Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:53 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a Nov 04 22:38:53 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:53 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:53 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info Nov 04 22:38:53 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:54 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:54 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info is being set with open permissions: ugo+rw Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:54 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info Nov 04 22:38:54 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Flow 'volume_create_manager' (483797e1-a606-4b67-976c-d1bf2236504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d587445f-55ac-4951-bb8f-3188ee35c587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:54 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.info" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d587445f-55ac-4951-bb8f-3188ee35c587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1658002689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01ebd59-bdbf-427c-95bc-d9e570ae7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69566c0bb0824620b7cc19346138b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:54Z,use_quota=True,user_id='a2613f96a7c34416a40483a39fc31699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf54fd9a-3519-46c3-b2dc-8f786f49cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf54fd9a-3519-46c3-b2dc-8f786f49cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17289f-8468-46b8-9c4a-ba7f80b422f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17289f-8468-46b8-9c4a-ba7f80b422f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01ebd59-bdbf-427c-95bc-d9e570ae7477', 'volume_name': 'volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8038409-faf1-4d68-8775-e9674c0b386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8038409-faf1-4d68-8775-e9674c0b386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9288d5-b358-4b52-b296-018d708e10b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:54 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Volume c01ebd59-bdbf-427c-95bc-d9e570ae7477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477', 'volume_size': 1} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1658002689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01ebd59-bdbf-427c-95bc-d9e570ae7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69566c0bb0824620b7cc19346138b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:54Z,use_quota=True,user_id='a2613f96a7c34416a40483a39fc31699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Creating volume c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:54 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:54 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 1073741824 Nov 04 22:38:54 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:54 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-00f0b513-3cc8-4e7c-bb7a-a8de45a42d56 tempest-ProjectReaderTests-121437089 None] Create snapshot completed successfully Nov 04 22:38:55 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 1073741824" returned: 0 in 0.471s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:55 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:38:55 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-af0ef80e-b505-40b8-98a4-cbd055439b2a-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-af0ef80e-b505-40b8-98a4-cbd055439b2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-af0ef80e-b505-40b8-98a4-cbd055439b2a" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-af0ef80e-b505-40b8-98a4-cbd055439b2a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Deleting offline snapshot af0ef80e-b505-40b8-98a4-cbd055439b2a of volume ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:38:55 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] snapshot_file for this snap is: volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.309s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558fbdf-0262-4d59-94e1-e67e6961bd69]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9288d5-b358-4b52-b296-018d708e10b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd77f8-4443-46c4-b663-62349707739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Volume volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 (c01ebd59-bdbf-427c-95bc-d9e570ae7477): created successfully Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd77f8-4443-46c4-b663-62349707739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Flow 'volume_create_manager' (483797e1-a606-4b67-976c-d1bf2236504b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a2a68b99-f336-46ff-835c-501a3b2901ab tempest-SnapshotDependencyTests-1062100513 None] Created volume successfully. Nov 04 22:38:55 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a Nov 04 22:38:55 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:55 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a" returned: 0 in 0.372s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ead62c49-42b1-4d10-8823-a21cd70f55fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef2711-7040-45ae-945c-ba5b1b524142]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:55 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc Nov 04 22:38:55 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:56 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc" returned: 0 in 0.384s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:56 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a Nov 04 22:38:56 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:56 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:56 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a Nov 04 22:38:56 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:56 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:56 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Creating offline snapshot c8891a3c-a3c7-43a1-b1ae-767b4c906600 of volume c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7968fe4-bd9e-4f28-a9f3-1e843aa87e7f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:56 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc.af0ef80e-b505-40b8-98a4-cbd055439b2a" returned: 0 in 0.316s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-af0ef80e-b505-40b8-98a4-cbd055439b2a" released by "_delete_snapshot" :: held 1.615s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" released by "delete_snapshot" :: held 1.647s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:56 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:38:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:38:56 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:38:56 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Created reservations ['b3bde7c4-6e7e-4bec-9737-7e0f405c9ac2', '9011d582-4e35-4ae9-b934-d71b4780e83f', 'a04a4b24-afc8-4e0b-b75f-bef21bbc5150', 'd463b43d-7b60-49c9-8145-e7d48e6bbabe'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:57 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Delete snapshot completed successfully. Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-0d0f5ab3-2da3-4443-9d5d-940bd02c54f0 tempest-ProjectReaderTests-121437089 None] Lock "cinder-af0ef80e-b505-40b8-98a4-cbd055439b2a-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:57 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.433s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:57 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 1G Nov 04 22:38:57 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-ead62c49-42b1-4d10-8823-a21cd70f55fc-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "cinder-ead62c49-42b1-4d10-8823-a21cd70f55fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a6a686-19ee-415f-b571-4f83cd007aca]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:57 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc Nov 04 22:38:57 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:57 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 1G" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:57 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:38:57 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:57 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc" returned: 0 in 0.419s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:58 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc Nov 04 22:38:58 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:58 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.392s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:58 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 is being set with open permissions: ugo+rw Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:58 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:38:58 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:58 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ead62c49-42b1-4d10-8823-a21cd70f55fc" returned: 0 in 0.282s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-ead62c49-42b1-4d10-8823-a21cd70f55fc" released by "delete_volume" :: held 0.779s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Created reservations ['1d929123-8223-4fbf-bdd9-1832997b9302', 'c4602945-999b-43d3-9b1c-b15686566d71', '07cfb687-46ed-4c3d-832a-76506e955ad6', 'b8600455-239f-4cee-9c3e-e43ca1917522'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:38:58 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.280s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:58 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:38:58 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:58 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info Nov 04 22:38:58 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:58 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:58 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info is being set with open permissions: ugo+rw Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:58 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.355s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:38:58 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info Nov 04 22:38:58 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Deleted volume successfully. Nov 04 22:38:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-38d74d70-f20f-421b-b437-354efe50a037 tempest-ProjectReaderTests-121437089 None] Lock "cinder-ead62c49-42b1-4d10-8823-a21cd70f55fc-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:38:59 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.info" returned: 0 in 0.331s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:59 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ca492907-9ce3-4186-92e1-a0e0d4daeb0c tempest-SnapshotDependencyTests-1062100513 None] Create snapshot completed successfully Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (ec787af2-e41d-4544-a688-529dd3d6ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5c0269-ce74-4ee1-afd0-2fd9ef76485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5c0269-ce74-4ee1-afd0-2fd9ef76485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442344135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8768d9f-4090-451f-a804-88dd1a59b0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:59Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00903bd-72b9-40c0-bfd3-1711b5780d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00903bd-72b9-40c0-bfd3-1711b5780d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4346b9-690d-4388-bb28-0e48c191d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4346b9-690d-4388-bb28-0e48c191d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8768d9f-4090-451f-a804-88dd1a59b0c6', 'volume_name': 'volume-d8768d9f-4090-451f-a804-88dd1a59b0c6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663a3b24-8b56-406a-9943-8ab28d8fb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663a3b24-8b56-406a-9943-8ab28d8fb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e3b535-f544-48b7-9d1c-348512c5576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:38:59 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Volume d8768d9f-4090-451f-a804-88dd1a59b0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8768d9f-4090-451f-a804-88dd1a59b0c6', 'volume_size': 1} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442344135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8768d9f-4090-451f-a804-88dd1a59b0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:38:59Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Creating volume d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:38:59 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:59 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 1073741824 Nov 04 22:38:59 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:59 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 1073741824" returned: 0 in 0.445s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:38:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:38:59 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 Nov 04 22:38:59 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:38:59 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e3b535-f544-48b7-9d1c-348512c5576e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8768d9f-4090-451f-a804-88dd1a59b0c6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e5b35d-0458-4a8a-97e8-c15a1f1a7747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Volume volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 (d8768d9f-4090-451f-a804-88dd1a59b0c6): created successfully Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e5b35d-0458-4a8a-97e8-c15a1f1a7747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (ec787af2-e41d-4544-a688-529dd3d6ce60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-45f59ccd-a560-4203-a273-b2386f055e74 tempest-ProjectReaderTests-121437089 None] Created volume successfully. Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Creating offline snapshot abbae39b-870e-441a-937f-97a9c3614e85 of volume d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b2f9d-4fe4-42c2-9d6c-07eee14fd274]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:00 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 Nov 04 22:39:00 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Flow 'volume_create_manager' (c3a0320c-abc8-49b5-afb9-c27801036e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae4c92a-691e-4f36-8f06-44abfe55f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae4c92a-691e-4f36-8f06-44abfe55f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a042a778-68f1-4a5c-8389-d33457aa4287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69566c0bb0824620b7cc19346138b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8891a3c-a3c7-43a1-b1ae-767b4c906600,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:01Z,use_quota=True,user_id='a2613f96a7c34416a40483a39fc31699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf67ff6d-4dcb-48a4-bcba-7c59be393afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf67ff6d-4dcb-48a4-bcba-7c59be393afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cb591d-ed38-4a44-9a82-e997ee01d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cb591d-ed38-4a44-9a82-e997ee01d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a042a778-68f1-4a5c-8389-d33457aa4287', 'volume_name': 'volume-a042a778-68f1-4a5c-8389-d33457aa4287', 'volume_size': 1, 'snapshot_id': 'c8891a3c-a3c7-43a1-b1ae-767b4c906600'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf42008-f933-4554-921b-a4c9c85bc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf42008-f933-4554-921b-a4c9c85bc275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b6262a-20bc-45c3-876e-4737d44e8cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:00 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Volume a042a778-68f1-4a5c-8389-d33457aa4287: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a042a778-68f1-4a5c-8389-d33457aa4287', 'volume_size': 1, 'snapshot_id': 'c8891a3c-a3c7-43a1-b1ae-767b4c906600'} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:00 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6" returned: 0 in 0.426s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:00 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 1G Nov 04 22:39:00 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (a4ee33d0-97a5-415b-a90e-7b79b586a71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfc1f55-7bb0-461e-9b87-a27fb77e56f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfc1f55-7bb0-461e-9b87-a27fb77e56f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712228555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fad4281-68f1-41a8-9ac2-c51b963c3a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:01Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c099e-6760-4f98-9b7f-72c5af409796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c099e-6760-4f98-9b7f-72c5af409796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59768361-6d14-4444-af2c-e4ae66be706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59768361-6d14-4444-af2c-e4ae66be706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fad4281-68f1-41a8-9ac2-c51b963c3a27', 'volume_name': 'volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbf56c6-10f5-4e41-bf94-297daf17c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbf56c6-10f5-4e41-bf94-297daf17c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e02cdd-da53-49c0-8a0d-169c680260dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:01 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Volume 4fad4281-68f1-41a8-9ac2-c51b963c3a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27', 'volume_size': 1} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:01 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 1G" returned: 0 in 0.484s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:01 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 Nov 04 22:39:01 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:01 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85" returned: 0 in 0.320s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:01 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 is being set with open permissions: ugo+rw Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:01 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 Nov 04 22:39:01 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:01 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:01 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info Nov 04 22:39:01 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:02 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:02 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info is being set with open permissions: ugo+rw Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:02 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info Nov 04 22:39:02 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:02 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.info" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.657s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600-a042a778-68f1-4a5c-8389-d33457aa4287" by "_create_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600-a042a778-68f1-4a5c-8389-d33457aa4287" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Creating volume a042a778-68f1-4a5c-8389-d33457aa4287 from snapshot c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" by "_copy_volume_from_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:02 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-aca97fa8-9166-4567-b0ec-db230594c364 tempest-ProjectReaderTests-121437089 None] Create snapshot completed successfully Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] snapshot: c8891a3c-a3c7-43a1-b1ae-767b4c906600, volume: a042a778-68f1-4a5c-8389-d33457aa4287, {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ffbfde-b590-4fad-ab1a-70d423370f8d]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:02 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:39:02 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:02 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b432a260-102e-4bea-859b-6e218b231e2f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:03 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:39:03 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:03 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Creating direct copy from snapshot {{(pid=87173) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.utils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Path /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 not found in is_blk_device check {{(pid=87173) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:03 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 Nov 04 22:39:03 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-abbae39b-870e-441a-937f-97a9c3614e85-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-abbae39b-870e-441a-937f-97a9c3614e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-abbae39b-870e-441a-937f-97a9c3614e85" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-abbae39b-870e-441a-937f-97a9c3614e85" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Deleting offline snapshot abbae39b-870e-441a-937f-97a9c3614e85 of volume d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] snapshot_file for this snap is: volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3210a16-34c4-4d56-9188-63c68b1bd48f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:03 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 Nov 04 22:39:03 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:04 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85" returned: 0 in 0.509s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8768d9f-4090-451f-a804-88dd1a59b0c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee7f811-fcc6-4685-946b-e366d3a9b450]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:04 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 Nov 04 22:39:04 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:04 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6" returned: 0 in 0.614s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:04 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 Nov 04 22:39:04 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:05 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85" returned: 0 in 0.564s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:05 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85 Nov 04 22:39:05 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:05 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6.abbae39b-870e-441a-937f-97a9c3614e85" returned: 0 in 0.492s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-abbae39b-870e-441a-937f-97a9c3614e85" released by "_delete_snapshot" :: held 2.382s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" released by "delete_snapshot" :: held 2.407s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Created reservations ['ca047ec8-9263-4103-9d14-1e80e82e930b', '3b6c78f3-00d3-4c76-89c6-c9ccde180571', 'efdf4e14-dde2-4524-a455-454a3d4763e0', '420201ce-f843-4028-bdfa-691a1870de96'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:06 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Delete snapshot completed successfully. Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-1a7d462b-e070-4e23-8859-8c10b768b4f2 tempest-ProjectReaderTests-121437089 None] Lock "cinder-abbae39b-870e-441a-937f-97a9c3614e85-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-d8768d9f-4090-451f-a804-88dd1a59b0c6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "cinder-d8768d9f-4090-451f-a804-88dd1a59b0c6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:06 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:07 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c1bc1-e872-443c-a959-db92c6d68a70]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:07 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 Nov 04 22:39:07 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:07 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6" returned: 0 in 0.822s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:07 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6 Nov 04 22:39:07 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:08 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d8768d9f-4090-451f-a804-88dd1a59b0c6" returned: 0 in 0.382s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-d8768d9f-4090-451f-a804-88dd1a59b0c6" released by "delete_volume" :: held 1.324s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Created reservations ['c287d830-7598-4d39-a2ba-e9c2ec7bbae0', 'eff8301d-bd7f-4d86-8eb7-ebc299ac1430', '5deaec2a-f481-44c8-bd65-700f54532f29', '9e7cc205-d8a9-4b6b-a276-b0d219ce8590'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:08 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:08 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:08 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.302s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:08 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Deleted volume successfully. Nov 04 22:39:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-20ffb58e-772d-4ab9-92b6-40c16d54e755 tempest-ProjectReaderTests-121437089 None] Lock "cinder-d8768d9f-4090-451f-a804-88dd1a59b0c6-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:10 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287" returned: 0 in 6.750s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.image.image_utils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Image conversion details: src /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 {{(pid=87173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 22:39:10 devstack cinder-volume[87173]: INFO cinder.image.image_utils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Converted 1024.00 MB image at 151.67 MB/s Nov 04 22:39:10 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 is being set with open permissions: ugo+rw Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:10 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 Nov 04 22:39:10 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (adf4f626-0402-4ed6-8c20-400e044d0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec4a609-916f-4582-a60c-ad525c296531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec4a609-916f-4582-a60c-ad525c296531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142056072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:10Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3980eff0-2cd9-45ad-ac5e-f10cc3af7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3980eff0-2cd9-45ad-ac5e-f10cc3af7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687a146-4036-4a7c-9c22-945544afe058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687a146-4036-4a7c-9c22-945544afe058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c', 'volume_name': 'volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f43c1a-aea6-490f-b961-0a9792004ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f43c1a-aea6-490f-b961-0a9792004ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faa72f1-456d-45a1-8c31-780b28262364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Volume 3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c', 'volume_size': 1} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:10 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287" returned: 0 in 0.244s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" released by "_copy_volume_from_snapshot" :: held 7.805s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600-a042a778-68f1-4a5c-8389-d33457aa4287" released by "_create_volume_from_snapshot" :: held 7.874s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.897s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.123s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712228555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fad4281-68f1-41a8-9ac2-c51b963c3a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:01Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Creating volume 4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:10 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:10 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 1073741824 Nov 04 22:39:10 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b6262a-20bc-45c3-876e-4737d44e8cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a042a778-68f1-4a5c-8389-d33457aa4287', 'volume_size': 1, 'snapshot_id': 'c8891a3c-a3c7-43a1-b1ae-767b4c906600'}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e25a3-79b6-44ad-97ab-6e2614eaedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Volume volume-a042a778-68f1-4a5c-8389-d33457aa4287 (a042a778-68f1-4a5c-8389-d33457aa4287): created successfully Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e25a3-79b6-44ad-97ab-6e2614eaedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Flow 'volume_create_manager' (c3a0320c-abc8-49b5-afb9-c27801036e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-80164d4c-6add-442d-9767-f399900d6195 tempest-SnapshotDependencyTests-1062100513 None] Created volume successfully. Nov 04 22:39:10 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 1073741824" returned: 0 in 0.406s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:10 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 Nov 04 22:39:10 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:11 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142056072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46e8c5070b4791907459da96fc9aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:10Z,use_quota=True,user_id='5d099e22f71349059a5fca686969f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Creating volume 3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:11 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e02cdd-da53-49c0-8a0d-169c680260dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:11 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c 1073741824 Nov 04 22:39:11 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9e290e-9168-4d13-917b-25673fd9820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Volume volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 (4fad4281-68f1-41a8-9ac2-c51b963c3a27): created successfully Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9e290e-9168-4d13-917b-25673fd9820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (a4ee33d0-97a5-415b-a90e-7b79b586a71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4bdd0a53-1177-40a0-9be3-f48ae9e56aff tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:11 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c 1073741824" returned: 0 in 0.425s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:11 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c Nov 04 22:39:11 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-c8891a3c-a3c7-43a1-b1ae-767b4c906600-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-c8891a3c-a3c7-43a1-b1ae-767b4c906600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Deleting offline snapshot c8891a3c-a3c7-43a1-b1ae-767b4c906600 of volume c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] snapshot_file for this snap is: volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175644c-4ce7-4524-8f6c-a7b90ecae736]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:11 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:39:11 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:11 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faa72f1-456d-45a1-8c31-780b28262364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cfc64e-b0f5-4d27-a29c-4126da80ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:11 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Volume volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c (3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c): created successfully Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cfc64e-b0f5-4d27-a29c-4126da80ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:11 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Flow 'volume_create_manager' (adf4f626-0402-4ed6-8c20-400e044d0696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:11 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b0528918-2662-43ce-bc84-b1a4fa52ceca tempest-ProjectReaderTests-121437089 None] Created volume successfully. Nov 04 22:39:12 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[770b65b3-ca81-43eb-be1f-565154f461c1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:12 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:39:12 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Creating offline snapshot 759f5de7-353c-4062-9e59-4ea87238db0d of volume 3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[495aad1a-ab20-43ba-90f2-e3aa25dd1f49]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:12 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c Nov 04 22:39:12 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:12 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.601s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:12 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:39:12 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:12 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" returned: 0 in 0.392s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:12 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d 1G Nov 04 22:39:12 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:13 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.333s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:13 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600 Nov 04 22:39:13 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:13 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d 1G" returned: 0 in 0.423s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:13 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d Nov 04 22:39:13 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:13 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477.c8891a3c-a3c7-43a1-b1ae-767b4c906600" returned: 0 in 0.276s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c8891a3c-a3c7-43a1-b1ae-767b4c906600" released by "_delete_snapshot" :: held 1.752s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" released by "delete_snapshot" :: held 1.775s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Created reservations ['a8045902-8665-462d-a510-1675c682b487', '4adc52a0-151c-4856-96b6-6076c29253d4', '70b2a2a8-5232-4151-958f-bd01a4e44b1f', '102df7cc-1de1-4063-a786-cb87e0bfd7d8'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:13 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Delete snapshot completed successfully. Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b189055d-d956-49aa-9b67-cc508ece2745 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-c8891a3c-a3c7-43a1-b1ae-767b4c906600-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:13 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d" returned: 0 in 0.310s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:13 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d is being set with open permissions: ugo+rw Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:13 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d Nov 04 22:39:13 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-c01ebd59-bdbf-427c-95bc-d9e570ae7477-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-c01ebd59-bdbf-427c-95bc-d9e570ae7477-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:13 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d" returned: 0 in 0.297s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d535090-2df5-4b07-b75e-0e9f4f3fda40]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:13 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info Nov 04 22:39:13 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:39:14 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info is being set with open permissions: ugo+rw Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:14 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info Nov 04 22:39:14 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.369s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:14 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477 Nov 04 22:39:14 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.info" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.977s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 683959fd-2cad-46a3-a1ca-0611b58a4d67 of volume 4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-6ad19d98-760a-414b-ab4c-d1e513e1daf2 tempest-ProjectReaderTests-121437089 None] Create snapshot completed successfully Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885689a-9a65-44bb-9a50-1e29ff5020c8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:14 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c01ebd59-bdbf-427c-95bc-d9e570ae7477" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-c01ebd59-bdbf-427c-95bc-d9e570ae7477" released by "delete_volume" :: held 0.683s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Created reservations ['aa2b927a-e383-4dd5-b176-232b3077c767', 'a215803a-f456-4450-9fed-6f64b95cb78b', 'e04ee8a6-83bb-4d08-850e-d84a0bf6cc5e', 'c9a220a6-ad58-476d-9498-87f2ad9d73a5'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:14 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 Nov 04 22:39:14 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:14 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:14 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27" returned: 0 in 0.391s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:14 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 1G Nov 04 22:39:14 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:14 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Deleted volume successfully. Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-a042a778-68f1-4a5c-8389-d33457aa4287-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-d34add43-e74d-4f25-b1ad-e0192e394dde tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-c01ebd59-bdbf-427c-95bc-d9e570ae7477-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-a042a778-68f1-4a5c-8389-d33457aa4287-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786c87a-7c4a-4f29-8c2c-07a88ac10aa7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 Nov 04 22:39:15 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:15 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 1G" returned: 0 in 0.438s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 Nov 04 22:39:15 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:15 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287" returned: 0 in 0.422s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287 Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-759f5de7-353c-4062-9e59-4ea87238db0d-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:15 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-759f5de7-353c-4062-9e59-4ea87238db0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-759f5de7-353c-4062-9e59-4ea87238db0d" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-759f5de7-353c-4062-9e59-4ea87238db0d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Deleting offline snapshot 759f5de7-353c-4062-9e59-4ea87238db0d of volume 3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] snapshot_file for this snap is: volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[39648d5b-9fd3-4549-93d1-d536502e9fb0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67" returned: 0 in 0.337s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:15 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 is being set with open permissions: ugo+rw Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 Nov 04 22:39:15 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:15 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d Nov 04 22:39:15 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:15 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-a042a778-68f1-4a5c-8389-d33457aa4287" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-quobyte-a042a778-68f1-4a5c-8389-d33457aa4287" released by "delete_volume" :: held 0.781s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Created reservations ['f087f914-584f-4e69-b7f4-0ca0f14ea160', '70245fec-094e-4274-9736-39b694ba644b', '7511097f-223b-4637-8bc7-3ff5da039a2b', '4cc4d3ca-eb86-448a-a766-d402597b5eb0'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:15 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67" returned: 0 in 0.299s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:15 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:15 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:16 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d" returned: 0 in 0.410s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:16 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info Nov 04 22:39:16 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fa2aa5-6914-49b9-82a9-7ec50b61abde]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:16 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c Nov 04 22:39:16 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:16 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Deleted volume successfully. Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f1885e95-cc4b-434d-97ea-daf82a334813 tempest-SnapshotDependencyTests-1062100513 None] Lock "cinder-a042a778-68f1-4a5c-8389-d33457aa4287-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:16 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info" returned: 0 in 0.300s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info is being set with open permissions: ugo+rw Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:16 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info Nov 04 22:39:16 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:16 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:16 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d Nov 04 22:39:16 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:16 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.info" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-828037e0-6a48-4f8c-ae0a-aa9c26137db4 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:16 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d" returned: 0 in 0.367s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:16 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d Nov 04 22:39:16 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:17 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c.759f5de7-353c-4062-9e59-4ea87238db0d" returned: 0 in 0.309s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-759f5de7-353c-4062-9e59-4ea87238db0d" released by "_delete_snapshot" :: held 1.644s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" released by "delete_snapshot" :: held 1.669s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Created reservations ['4e2d95d2-cd2a-4fbf-89e6-29262ffc3b92', '5c7b47cd-8b07-4efe-b2dd-496f6f1aa39b', '688e8573-f2bb-47e0-b3bb-9948481ec3fe', 'b32467da-d8b5-478c-a579-cc6627dc08ac'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Delete snapshot completed successfully. Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-086b08b2-276a-4989-85dc-e2d38d1fa0aa tempest-ProjectReaderTests-121437089 None] Lock "cinder-759f5de7-353c-4062-9e59-4ea87238db0d-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-683959fd-2cad-46a3-a1ca-0611b58a4d67-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-683959fd-2cad-46a3-a1ca-0611b58a4d67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-683959fd-2cad-46a3-a1ca-0611b58a4d67" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-683959fd-2cad-46a3-a1ca-0611b58a4d67" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 683959fd-2cad-46a3-a1ca-0611b58a4d67 of volume 4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[65744bcb-1e76-4d93-8daa-e7aa31df399a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "cinder-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Acquiring lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab78a57f-ae99-4cdb-98ab-527e79a09f1a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:17 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 Nov 04 22:39:17 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:18 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c Nov 04 22:39:18 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:18 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67" returned: 0 in 0.489s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[77255697-b943-4697-895f-4ffdef075eef]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:18 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" returned: 0 in 0.399s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:18 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c Nov 04 22:39:18 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:18 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 Nov 04 22:39:18 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:18 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "cinder-quobyte-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c" released by "delete_volume" :: held 0.764s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:18 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27" returned: 0 in 0.400s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:18 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 Nov 04 22:39:18 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Created reservations ['1f168182-128d-422f-ae58-087aaf93a62e', '37baaea1-ee1b-4848-afeb-b8669e2be6dd', '6169cf59-92e6-4346-b6dd-a6658d1db739', '8a8845a6-c72a-47b5-bfb6-fd7349df52ad'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:18 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:18 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:19 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:19 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67" returned: 0 in 0.408s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Deleted volume successfully. Nov 04 22:39:19 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67 Nov 04 22:39:19 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4ff04d85-5cc4-46d9-8bb1-a3e6cdde46dd tempest-ProjectReaderTests-121437089 None] Lock "cinder-3d4d3e3b-4817-4120-9db4-dd8f18fa4b7c-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:19 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27.683959fd-2cad-46a3-a1ca-0611b58a4d67" returned: 0 in 0.298s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-683959fd-2cad-46a3-a1ca-0611b58a4d67" released by "_delete_snapshot" :: held 1.725s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" released by "delete_snapshot" :: held 1.760s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Created reservations ['c6426988-827b-4edd-b5a2-97a57d5bb7fd', '08608076-a23e-4c55-a5d9-c47cee527310', 'd3322304-dc6f-42a1-827e-872d635dd69d', '5427d75c-044d-4c5e-ab2d-fc29d0ec0127'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-4e6aacde-98a6-4ae4-ab46-592f194dec48 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-683959fd-2cad-46a3-a1ca-0611b58a4d67-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-4fad4281-68f1-41a8-9ac2-c51b963c3a27-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "cinder-4fad4281-68f1-41a8-9ac2-c51b963c3a27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd460f5-685a-4374-9fd2-a5204100be63]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:20 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 Nov 04 22:39:20 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:20 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27" returned: 0 in 0.394s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:20 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27 Nov 04 22:39:20 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:20 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-4fad4281-68f1-41a8-9ac2-c51b963c3a27" returned: 0 in 0.310s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4fad4281-68f1-41a8-9ac2-c51b963c3a27" released by "delete_volume" :: held 0.797s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Created reservations ['fa3b3839-668d-41cb-8b33-edfeed1823e7', '54f0870e-a110-40d4-8671-d742449817a7', '00026409-dc77-4033-80c9-d7c1de95538e', 'c2a61f5c-27be-452f-a19d-fa48ddb033f2'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:21 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:21 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:21 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.347s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-37de8b67-ec48-4e0a-ac8b-08795246b21f tempest-ProjectMemberTests-2093852638 None] Lock "cinder-4fad4281-68f1-41a8-9ac2-c51b963c3a27-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (7f50934b-5462-4527-8f9a-e7de38fea6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d50266-c581-4310-a452-f344839984a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d50266-c581-4310-a452-f344839984a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592312275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443da571-ceea-48c1-95e6-4e768be3ccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:22Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6f522-471c-433d-a416-30cc36c65c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6f522-471c-433d-a416-30cc36c65c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d644b-1403-479f-be1e-1f224b9b661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d644b-1403-479f-be1e-1f224b9b661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443da571-ceea-48c1-95e6-4e768be3ccc6', 'volume_name': 'volume-443da571-ceea-48c1-95e6-4e768be3ccc6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e5c6a6-47fe-4a57-938c-b8853247b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e5c6a6-47fe-4a57-938c-b8853247b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40785ca-00f7-4dc2-a17b-035232fa79df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:21 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Volume 443da571-ceea-48c1-95e6-4e768be3ccc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443da571-ceea-48c1-95e6-4e768be3ccc6', 'volume_size': 1} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592312275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443da571-ceea-48c1-95e6-4e768be3ccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:22Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Creating volume 443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:21 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:21 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 1073741824 Nov 04 22:39:21 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:22 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 1073741824" returned: 0 in 0.570s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:22 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 Nov 04 22:39:22 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:22 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6" returned: 0 in 0.262s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40785ca-00f7-4dc2-a17b-035232fa79df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443da571-ceea-48c1-95e6-4e768be3ccc6', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea015fca-4a8e-42d6-aba6-769599372117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:22 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Volume volume-443da571-ceea-48c1-95e6-4e768be3ccc6 (443da571-ceea-48c1-95e6-4e768be3ccc6): created successfully Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea015fca-4a8e-42d6-aba6-769599372117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:22 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (7f50934b-5462-4527-8f9a-e7de38fea6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:22 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bb8b809c-4a6d-466c-8342-a50ca56d327f tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot a078f5b3-f087-49da-8f85-64f2332faa22 of volume 443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:23 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a0890-7cf0-4be7-8a56-8873ce17eea4]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:24 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 Nov 04 22:39:24 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:24 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:24 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 1G Nov 04 22:39:24 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:24 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 1G" returned: 0 in 0.488s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:24 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443da571-ceea-48c1-95e6-4e768be3ccc6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:24 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443da571-ceea-48c1-95e6-4e768be3ccc6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 Nov 04 22:39:24 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:25 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443da571-ceea-48c1-95e6-4e768be3ccc6 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22" returned: 0 in 0.301s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:25 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 is being set with open permissions: ugo+rw Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:25 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 Nov 04 22:39:25 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:25 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:25 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info Nov 04 22:39:25 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:25 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info" returned: 0 in 0.294s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:25 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info is being set with open permissions: ugo+rw Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:25 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info Nov 04 22:39:25 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:25 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.info" returned: 0 in 0.272s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:25 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:26 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-41adf812-0b7c-4847-b471-adad02dfdb25 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-a078f5b3-f087-49da-8f85-64f2332faa22-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-a078f5b3-f087-49da-8f85-64f2332faa22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-a078f5b3-f087-49da-8f85-64f2332faa22" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-a078f5b3-f087-49da-8f85-64f2332faa22" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot a078f5b3-f087-49da-8f85-64f2332faa22 of volume 443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54a56a5-146c-4421-bb66-8c1ed117794e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:27 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 Nov 04 22:39:27 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:27 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22" returned: 0 in 0.388s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443da571-ceea-48c1-95e6-4e768be3ccc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7db50-6c09-464f-9d3e-e7090d32b6cb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:27 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 Nov 04 22:39:27 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:27 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6" returned: 0 in 0.420s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:27 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:28 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 Nov 04 22:39:28 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:28 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22" returned: 0 in 0.404s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:28 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22 Nov 04 22:39:28 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:28 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6.a078f5b3-f087-49da-8f85-64f2332faa22" returned: 0 in 0.266s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-a078f5b3-f087-49da-8f85-64f2332faa22" released by "_delete_snapshot" :: held 1.598s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" released by "delete_snapshot" :: held 1.622s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=163,cinder:INSERT=53,cinder:UPDATE=197,cinder:DELETE=20 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:UPDATE=190,cinder:SELECT=148,cinder:INSERT=52,cinder:DELETE=13 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Created reservations ['f47c12c8-04f2-4f41-b5c0-3552ecbc7eff', '61bfeb21-3c0a-411e-9f80-1069eecc2332', 'b31fb892-bedf-4e15-80e1-474710a1816f', 'fcae849f-79b0-4ea7-9d6d-0b61a2fd5945'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:28 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:39:28 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-a9f5b206-b683-4e39-8ba7-486ebfb03088 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-a078f5b3-f087-49da-8f85-64f2332faa22-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-443da571-ceea-48c1-95e6-4e768be3ccc6-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "cinder-443da571-ceea-48c1-95e6-4e768be3ccc6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[e546e55d-fff5-42f7-87c2-682ddd0e8a58]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:29 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 Nov 04 22:39:29 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:29 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6" returned: 0 in 0.399s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:29 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:29 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6 Nov 04 22:39:29 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:30 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-443da571-ceea-48c1-95e6-4e768be3ccc6" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-443da571-ceea-48c1-95e6-4e768be3ccc6" released by "delete_volume" :: held 0.728s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Created reservations ['96ff2a83-b4f1-464b-8606-cf8e212e16a3', '2c0219b7-19f4-4c12-99bb-f0da338fe168', '85835583-c48f-499c-846d-c09eb9de72c4', 'a9b2281e-0651-4268-bd05-0c965ed088cc'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:30 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:30 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:30 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:30 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-fd029c32-b31c-40bb-af48-8a17b1eb4e6c tempest-ProjectMemberTests-2093852638 None] Lock "cinder-443da571-ceea-48c1-95e6-4e768be3ccc6-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (5c321dd1-6b4c-433a-a001-e34752f8fc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b9098a-ef8a-426e-9311-b609a0215c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b9098a-ef8a-426e-9311-b609a0215c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384572523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0698ea8d-1ed3-46a9-9228-b61739210e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:31Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfd2833-a498-42cc-8421-8ab87663bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfd2833-a498-42cc-8421-8ab87663bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:30 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d1afe-36fe-40a8-aea9-6dec32b4970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d1afe-36fe-40a8-aea9-6dec32b4970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0698ea8d-1ed3-46a9-9228-b61739210e1e', 'volume_name': 'volume-0698ea8d-1ed3-46a9-9228-b61739210e1e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744eb0b1-e763-4786-a737-4abf76303647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744eb0b1-e763-4786-a737-4abf76303647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3bbded-415c-4620-9916-a6daf068d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Volume 0698ea8d-1ed3-46a9-9228-b61739210e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0698ea8d-1ed3-46a9-9228-b61739210e1e', 'volume_size': 1} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384572523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0698ea8d-1ed3-46a9-9228-b61739210e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:31Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Creating volume 0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:31 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e 1073741824 Nov 04 22:39:31 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:31 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e 1073741824" returned: 0 in 0.455s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:31 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e Nov 04 22:39:31 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:31 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e" returned: 0 in 0.277s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3bbded-415c-4620-9916-a6daf068d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0698ea8d-1ed3-46a9-9228-b61739210e1e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a5ff76-bc4d-4d90-b8f1-bbc5e1e0d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Volume volume-0698ea8d-1ed3-46a9-9228-b61739210e1e (0698ea8d-1ed3-46a9-9228-b61739210e1e): created successfully Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a5ff76-bc4d-4d90-b8f1-bbc5e1e0d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (5c321dd1-6b4c-433a-a001-e34752f8fc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a688c474-cf98-4506-ab7a-f9bfce2cfdc4 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (e3acace1-88dd-4575-a980-46702366d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09447a6-595b-4d87-a590-a640b5ed2160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09447a6-595b-4d87-a590-a640b5ed2160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643960114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878a83ce-df48-47f7-8010-7f93b797ef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:32Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0755f48-b238-4d00-9a49-6df3ed8a1f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0755f48-b238-4d00-9a49-6df3ed8a1f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4707ca4c-f733-444e-b3ab-9a0d4051c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4707ca4c-f733-444e-b3ab-9a0d4051c677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878a83ce-df48-47f7-8010-7f93b797ef2c', 'volume_name': 'volume-878a83ce-df48-47f7-8010-7f93b797ef2c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756b9261-2e8e-44e7-9fd7-c2c3c285e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756b9261-2e8e-44e7-9fd7-c2c3c285e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a031797-7129-47b7-8248-7a5a91e946a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Volume 878a83ce-df48-47f7-8010-7f93b797ef2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878a83ce-df48-47f7-8010-7f93b797ef2c', 'volume_size': 1} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643960114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878a83ce-df48-47f7-8010-7f93b797ef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:32Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Creating volume 878a83ce-df48-47f7-8010-7f93b797ef2c {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:31 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:31 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:32 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c 1073741824 Nov 04 22:39:32 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:32 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c 1073741824" returned: 0 in 0.428s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:32 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c Nov 04 22:39:32 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:32 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a031797-7129-47b7-8248-7a5a91e946a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878a83ce-df48-47f7-8010-7f93b797ef2c', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c377ea-c7d2-46be-b406-ec288e4c9b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:32 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Volume volume-878a83ce-df48-47f7-8010-7f93b797ef2c (878a83ce-df48-47f7-8010-7f93b797ef2c): created successfully Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c377ea-c7d2-46be-b406-ec288e4c9b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:32 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (e3acace1-88dd-4575-a980-46702366d630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:32 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-95dafc7c-075d-4f33-bbf7-bb2646bd6887 tempest-ProjectReaderTests-252038107 None] Created volume successfully. Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-878a83ce-df48-47f7-8010-7f93b797ef2c-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "cinder-878a83ce-df48-47f7-8010-7f93b797ef2c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-quobyte-878a83ce-df48-47f7-8010-7f93b797ef2c" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-878a83ce-df48-47f7-8010-7f93b797ef2c" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecaaab2-5dc4-44dc-8963-c654b424e84e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 46320312-ddca-488b-b2d6-3d2eec3ece4a of volume 0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c51f4-d442-468f-bbb6-04923b2a5144]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:33 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c Nov 04 22:39:33 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:33 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e Nov 04 22:39:33 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:33 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c" returned: 0 in 0.365s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:33 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c Nov 04 22:39:33 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:33 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:33 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a 1G Nov 04 22:39:33 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:33 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-878a83ce-df48-47f7-8010-7f93b797ef2c" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-878a83ce-df48-47f7-8010-7f93b797ef2c" released by "delete_volume" :: held 0.673s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Created reservations ['e062e41e-2b26-4f32-a307-f743152b266a', 'd290953c-48ad-4e9d-a905-7bb18acc94e7', '4b49a0b1-2b8e-4fdd-8f8b-fc588825676e', 'a6d03be7-66e5-43e5-9c40-d39630d4a220'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:33 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:33 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:33 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:34 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a 1G" returned: 0 in 0.440s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0698ea8d-1ed3-46a9-9228-b61739210e1e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:34 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0698ea8d-1ed3-46a9-9228-b61739210e1e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a Nov 04 22:39:34 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:34 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.270s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:34 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Deleted volume successfully. Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-72099272-a996-48d8-b6c2-07564bf6fe6a tempest-ProjectReaderTests-252038107 None] Lock "cinder-878a83ce-df48-47f7-8010-7f93b797ef2c-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:34 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0698ea8d-1ed3-46a9-9228-b61739210e1e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a" returned: 0 in 0.320s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:34 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a is being set with open permissions: ugo+rw Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:34 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a Nov 04 22:39:34 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:34 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a" returned: 0 in 0.269s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:34 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info Nov 04 22:39:34 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (9ed1a708-061b-4b32-addc-8f2cc740454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5723b25e-55be-4b86-9a86-10cb564691cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5723b25e-55be-4b86-9a86-10cb564691cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85701105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef478cb-fa34-4540-a481-fd816c19c33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:35Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c9d86b-ca84-4a4f-a965-807f9eb16a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c9d86b-ca84-4a4f-a965-807f9eb16a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13d53be-244f-4a4f-9c87-aeea8298b797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13d53be-244f-4a4f-9c87-aeea8298b797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef478cb-fa34-4540-a481-fd816c19c33f', 'volume_name': 'volume-bef478cb-fa34-4540-a481-fd816c19c33f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849a7ea-0f7c-48a8-81ec-1caa35bba6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849a7ea-0f7c-48a8-81ec-1caa35bba6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422990b2-11ee-4222-b8e6-7141e4ed6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:34 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Volume bef478cb-fa34-4540-a481-fd816c19c33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef478cb-fa34-4540-a481-fd816c19c33f', 'volume_size': 1} Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:34 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:34 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info is being set with open permissions: ugo+rw Nov 04 22:39:34 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:34 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info Nov 04 22:39:34 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:35 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.info" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85701105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef478cb-fa34-4540-a481-fd816c19c33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:35Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Creating volume bef478cb-fa34-4540-a481-fd816c19c33f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:35 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:35 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f 1073741824 Nov 04 22:39:35 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-99cd2d6e-7916-468c-9dd8-11b8b924cc21 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-46320312-ddca-488b-b2d6-3d2eec3ece4a-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-46320312-ddca-488b-b2d6-3d2eec3ece4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-46320312-ddca-488b-b2d6-3d2eec3ece4a" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-46320312-ddca-488b-b2d6-3d2eec3ece4a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 46320312-ddca-488b-b2d6-3d2eec3ece4a of volume 0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275d981-0bc9-4782-b68e-e9efaf814486]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:35 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a Nov 04 22:39:35 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:35 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f 1073741824" returned: 0 in 0.432s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:35 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f Nov 04 22:39:35 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:35 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a" returned: 0 in 0.390s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0698ea8d-1ed3-46a9-9228-b61739210e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce705e-d184-4239-800b-6783c80dabbb]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:35 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f" returned: 0 in 0.245s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422990b2-11ee-4222-b8e6-7141e4ed6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef478cb-fa34-4540-a481-fd816c19c33f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed11c9d-6117-463d-8029-bd31696c56ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:35 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Volume volume-bef478cb-fa34-4540-a481-fd816c19c33f (bef478cb-fa34-4540-a481-fd816c19c33f): created successfully Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed11c9d-6117-463d-8029-bd31696c56ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:35 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (9ed1a708-061b-4b32-addc-8f2cc740454c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:35 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b874d5d0-45cc-4bfe-b8aa-1249f258d5bb tempest-ProjectReaderTests-252038107 None] Created volume successfully. Nov 04 22:39:35 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e Nov 04 22:39:35 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:36 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e" returned: 0 in 0.360s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:36 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a Nov 04 22:39:36 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:36 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a" returned: 0 in 0.326s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:36 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a Nov 04 22:39:36 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-bef478cb-fa34-4540-a481-fd816c19c33f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "cinder-bef478cb-fa34-4540-a481-fd816c19c33f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:36 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e.46320312-ddca-488b-b2d6-3d2eec3ece4a" returned: 0 in 0.278s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-46320312-ddca-488b-b2d6-3d2eec3ece4a" released by "_delete_snapshot" :: held 1.461s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" released by "delete_snapshot" :: held 1.494s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-quobyte-bef478cb-fa34-4540-a481-fd816c19c33f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-bef478cb-fa34-4540-a481-fd816c19c33f" acquired by "delete_volume" :: waited 0.022s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a26586-0b33-489a-8b6e-5ddacbcdd1c8]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:36 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Created reservations ['4e5ec298-9b5e-46d7-a798-177c8214c1fc', 'ad1916a8-6e54-430d-8209-b0dbc250e30d', 'dd01adaf-6423-4ccf-920d-1fcf79396a7c', 'bf2f2206-3976-4a86-b4e4-eee1a08db4ec'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:37 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-f6b8d5df-e308-44dd-8bbe-df19685cbed3 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-46320312-ddca-488b-b2d6-3d2eec3ece4a-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:37 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f Nov 04 22:39:37 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:37 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f" returned: 0 in 0.361s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:37 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f Nov 04 22:39:37 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-0698ea8d-1ed3-46a9-9228-b61739210e1e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-0698ea8d-1ed3-46a9-9228-b61739210e1e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:37 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-bef478cb-fa34-4540-a481-fd816c19c33f" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-bef478cb-fa34-4540-a481-fd816c19c33f" released by "delete_volume" :: held 0.668s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" acquired by "delete_volume" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a8950-c032-4eb6-a781-6f37fe0d574f]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Created reservations ['56a2abdf-52a4-4601-89f0-1bfc3c0f8957', 'faea8b05-84cc-4aa5-8b17-b72ac77831f1', 'c00c5c39-ebc8-40bf-bea9-ca4873579784', '00dbd6b6-1146-4ce2-91b3-3e7a65706a89'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:37 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:37 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e Nov 04 22:39:37 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:37 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:37 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:38 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Deleted volume successfully. Nov 04 22:39:38 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e" returned: 0 in 0.399s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-b75b6a7c-03f0-46f2-b9d4-3f596651ab31 tempest-ProjectReaderTests-252038107 None] Lock "cinder-bef478cb-fa34-4540-a481-fd816c19c33f-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:38 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e Nov 04 22:39:38 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:38 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-0698ea8d-1ed3-46a9-9228-b61739210e1e" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-0698ea8d-1ed3-46a9-9228-b61739210e1e" released by "delete_volume" :: held 0.745s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Created reservations ['47a94e3a-902f-480f-a10d-a2876d533f1c', '9b677f0a-6275-4e36-acec-dd028d29f14b', 'ea9ec2bf-3bf6-4211-ad5a-6c39bd46858c', '0001e469-9f39-430b-866c-35a86f49fec7'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (7ede2442-a34e-430e-b501-52a1d0ad20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7982433-002f-446e-b489-5da1bfa76d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7982433-002f-446e-b489-5da1bfa76d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704207655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc1862-28c0-48cb-92fc-4ed957c2875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:38Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdca557-8720-45a7-bab4-6782d892467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdca557-8720-45a7-bab4-6782d892467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730fc965-aa91-4216-b0bd-a449d361f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730fc965-aa91-4216-b0bd-a449d361f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdc1862-28c0-48cb-92fc-4ed957c2875a', 'volume_name': 'volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb1f17-29e7-4e64-8164-f863026bb44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb1f17-29e7-4e64-8164-f863026bb44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf31c4ca-1921-4227-ab6b-2f59b2c47f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:38 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Volume ccdc1862-28c0-48cb-92fc-4ed957c2875a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a', 'volume_size': 1} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704207655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc1862-28c0-48cb-92fc-4ed957c2875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:38Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Creating volume ccdc1862-28c0-48cb-92fc-4ed957c2875a {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:38 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:38 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a 1073741824 Nov 04 22:39:38 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:38 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:38 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:38 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.288s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:38 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:39:38 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-711f840b-404a-4fbc-adb2-68d310bcf56e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-0698ea8d-1ed3-46a9-9228-b61739210e1e-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:39 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a 1073741824" returned: 0 in 0.545s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:39 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a Nov 04 22:39:39 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (2ebbaa8d-e6f3-4d0d-8faf-9e8da619d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d71e7a-5955-4fd2-a853-122eb427710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d71e7a-5955-4fd2-a853-122eb427710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297531892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4706959-6d9a-4f8d-8673-7b835168ccc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:39Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54b5d80-e41b-45d8-a618-2f95857bffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54b5d80-e41b-45d8-a618-2f95857bffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495e8e16-e1e6-4eb0-a8f4-1f0f490c2bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495e8e16-e1e6-4eb0-a8f4-1f0f490c2bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4706959-6d9a-4f8d-8673-7b835168ccc1', 'volume_name': 'volume-d4706959-6d9a-4f8d-8673-7b835168ccc1', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33895e2-caca-40dc-8292-1f834537f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33895e2-caca-40dc-8292-1f834537f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd13b23c-1bf7-4157-9aad-1617bb5ff664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Volume d4706959-6d9a-4f8d-8673-7b835168ccc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4706959-6d9a-4f8d-8673-7b835168ccc1', 'volume_size': 1} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:39 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297531892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4706959-6d9a-4f8d-8673-7b835168ccc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:39Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Creating volume d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:39 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf31c4ca-1921-4227-ab6b-2f59b2c47f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 1073741824 Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea08f007-feb8-4bc3-b8ed-d852ff4a78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:39 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:39 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Volume volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a (ccdc1862-28c0-48cb-92fc-4ed957c2875a): created successfully Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea08f007-feb8-4bc3-b8ed-d852ff4a78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (7ede2442-a34e-430e-b501-52a1d0ad20ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:39 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-1f2f1dda-c442-4dca-82c9-e146fe027871 tempest-ProjectReaderTests-252038107 None] Created volume successfully. Nov 04 22:39:39 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 1073741824" returned: 0 in 0.411s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:39 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:39 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 Nov 04 22:39:39 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:40 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd13b23c-1bf7-4157-9aad-1617bb5ff664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4706959-6d9a-4f8d-8673-7b835168ccc1', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43dd06f-e3f7-4111-902e-5a2e4ddd2ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:40 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Volume volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 (d4706959-6d9a-4f8d-8673-7b835168ccc1): created successfully Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43dd06f-e3f7-4111-902e-5a2e4ddd2ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (2ebbaa8d-e6f3-4d0d-8faf-9e8da619d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:40 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-17e3abc7-2e13-465e-9eca-0dbfdc7723f0 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-ccdc1862-28c0-48cb-92fc-4ed957c2875a-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "cinder-ccdc1862-28c0-48cb-92fc-4ed957c2875a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-quobyte-ccdc1862-28c0-48cb-92fc-4ed957c2875a" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-ccdc1862-28c0-48cb-92fc-4ed957c2875a" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa128c-cdfb-49f2-acd3-545a16f7112c]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:40 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:40 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a Nov 04 22:39:40 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:41 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:41 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a Nov 04 22:39:41 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:41 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-ccdc1862-28c0-48cb-92fc-4ed957c2875a" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-ccdc1862-28c0-48cb-92fc-4ed957c2875a" released by "delete_volume" :: held 0.652s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Created reservations ['22b04a78-692c-419b-ad28-931812a86b90', '04eb7662-efc7-416b-93f2-e132d0fd2d40', '1c988102-ac5e-43c0-bcba-c69294875d0e', '3b3185fa-d0d8-4c41-afaf-420799bf3102'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:41 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:41 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 4b8ad148-c43b-4092-a8af-41f5ca6e10d2 of volume d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f3cd9-0d7b-46d4-8e59-24be6e9a1ba4]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:41 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 Nov 04 22:39:41 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:41 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.260s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:41 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Deleted volume successfully. Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-bd84dfaa-8b7f-4fa1-92ed-90213bc23e2f tempest-ProjectReaderTests-252038107 None] Lock "cinder-ccdc1862-28c0-48cb-92fc-4ed957c2875a-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:41 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1" returned: 0 in 0.398s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:41 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:41 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 1G Nov 04 22:39:41 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (1ae4fb35-dbf6-44f6-bfc7-e02ee73375c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e64d3a-1e91-4115-bbc0-509254f0e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e64d3a-1e91-4115-bbc0-509254f0e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823830537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:42Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838a6a2-5188-41a3-8ff2-537f4be81149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838a6a2-5188-41a3-8ff2-537f4be81149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747c206e-056d-4572-9fd7-abc5f8b48f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747c206e-056d-4572-9fd7-abc5f8b48f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3', 'volume_name': 'volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9097054-01d2-48e0-87bf-4c749bfd186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9097054-01d2-48e0-87bf-4c749bfd186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d24772-d831-4a6c-960a-d4a913089688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:42 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Volume 90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3', 'volume_size': 1} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:42 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 1G" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:42 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 Nov 04 22:39:42 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:42 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2" returned: 0 in 0.286s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:42 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 is being set with open permissions: ugo+rw Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:42 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 Nov 04 22:39:42 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:42 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2" returned: 0 in 0.242s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:42 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:42 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info Nov 04 22:39:42 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:43 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info" returned: 0 in 0.259s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:43 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info is being set with open permissions: ugo+rw Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:43 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info Nov 04 22:39:43 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:43 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.info" returned: 0 in 0.230s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823830537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9bcf1783d84a1e93ae2847704a3e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:42Z,use_quota=True,user_id='c8007fa7f3f4480db004a4f9e9871406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Creating volume 90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:43 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:43 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 1073741824 Nov 04 22:39:43 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:43 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-2477945c-0146-469a-89b9-1d596e54fccb tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-4b8ad148-c43b-4092-a8af-41f5ca6e10d2-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-4b8ad148-c43b-4092-a8af-41f5ca6e10d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-4b8ad148-c43b-4092-a8af-41f5ca6e10d2" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4b8ad148-c43b-4092-a8af-41f5ca6e10d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 4b8ad148-c43b-4092-a8af-41f5ca6e10d2 of volume d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1d4fd-c90b-499d-afee-261b0dc03bf0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:43 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 Nov 04 22:39:43 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:43 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 1073741824" returned: 0 in 0.468s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:43 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:43 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 Nov 04 22:39:43 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:44 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2" returned: 0 in 0.389s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4706959-6d9a-4f8d-8673-7b835168ccc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e993ea-f27e-4935-b850-71562605ffe1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:44 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" returned: 0 in 0.274s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d24772-d831-4a6c-960a-d4a913089688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4c23f-2687-45db-86f5-cf22e187bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:44 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Volume volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 (90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3): created successfully Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4c23f-2687-45db-86f5-cf22e187bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Flow 'volume_create_manager' (1ae4fb35-dbf6-44f6-bfc7-e02ee73375c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:44 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-eeed71a6-2188-49f8-857d-9b1d1c1623df tempest-ProjectReaderTests-252038107 None] Created volume successfully. Nov 04 22:39:44 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 Nov 04 22:39:44 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:44 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1" returned: 0 in 0.370s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:44 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 Nov 04 22:39:44 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:44 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:44 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:44 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2 Nov 04 22:39:44 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:45 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1.4b8ad148-c43b-4092-a8af-41f5ca6e10d2" returned: 0 in 0.254s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-4b8ad148-c43b-4092-a8af-41f5ca6e10d2" released by "_delete_snapshot" :: held 1.455s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" released by "delete_snapshot" :: held 1.479s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Created reservations ['cef2b678-66fe-4d5b-bf47-144ccfb135cf', '61ae96af-7587-47a3-b119-8f9efef65c0c', '03b96c1c-dd22-4978-b1d5-6eca3368fba5', '5b67e616-434c-4e37-b39e-da6e3d7053d8'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:45 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-16ed0ad0-f9fb-42de-bfc8-409e0e224094 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-4b8ad148-c43b-4092-a8af-41f5ca6e10d2-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "cinder-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Acquiring lock "cinder-quobyte-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd3340-58d5-4afb-9353-0edbefedd1a6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:45 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 Nov 04 22:39:45 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-d4706959-6d9a-4f8d-8673-7b835168ccc1-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "cinder-d4706959-6d9a-4f8d-8673-7b835168ccc1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529dd0a-585f-40b7-b6c3-fa00aeccc902]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:45 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" returned: 0 in 0.400s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:45 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:45 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3 Nov 04 22:39:45 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:46 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 Nov 04 22:39:46 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:46 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" returned: 0 in 0.258s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "cinder-quobyte-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3" released by "delete_volume" :: held 0.706s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Created reservations ['e0ce40fb-4172-4e7b-a186-994624d20822', '39b3ba8d-c9dc-470f-8f61-17dfbdeb22f7', '15000df9-65b8-4c32-ad1a-a0c20bdead9c', 'bb1c6392-d678-4fe1-bec7-aaf390ae7f04'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:46 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1" returned: 0 in 0.377s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:46 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1 Nov 04 22:39:46 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:46 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:46 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:46 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-d4706959-6d9a-4f8d-8673-7b835168ccc1" returned: 0 in 0.268s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-d4706959-6d9a-4f8d-8673-7b835168ccc1" released by "delete_volume" :: held 0.715s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:46 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.264s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:46 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Deleted volume successfully. Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Created reservations ['37426f7c-32bc-4c1a-8a5f-b29a44e62434', '4c153410-1fed-4edf-ba5a-64b42304aeef', 'e0c68bee-e4fd-4bf7-b158-1723c7bf0b72', '1e8bd496-265c-4fcc-a044-9a0c778f61ae'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-87958479-7d7d-417a-95d6-564acb883830 tempest-ProjectReaderTests-252038107 None] Lock "cinder-90f755a2-ba9e-4e89-9dcc-0e9a4d9760c3-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:46 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:46 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:46 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:47 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:47 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-552605ec-fe92-4021-a453-5588bfa4a7db tempest-ProjectMemberTests-2093852638 None] Lock "cinder-d4706959-6d9a-4f8d-8673-7b835168ccc1-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (88231988-0e6d-4339-8e7e-c69a3a569333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22541a5e-b993-4ed7-af79-39aa35a34528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22541a5e-b993-4ed7-af79-39aa35a34528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788206463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3fc4b9-b1f6-47c9-85f7-aa8132af4152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:47Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543f84d-5576-4973-b732-ac2d280fad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543f84d-5576-4973-b732-ac2d280fad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c761f30-01be-4c34-b1a1-eac5c860b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c761f30-01be-4c34-b1a1-eac5c860b565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3fc4b9-b1f6-47c9-85f7-aa8132af4152', 'volume_name': 'volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c83857d-84e9-46e8-8ff5-9afc8be6ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c83857d-84e9-46e8-8ff5-9afc8be6ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0aaa2f-8341-46b0-8a28-247efea05f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:47 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Volume 2f3fc4b9-b1f6-47c9-85f7-aa8132af4152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152', 'volume_size': 1} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788206463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3fc4b9-b1f6-47c9-85f7-aa8132af4152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:47Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Creating volume 2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:47 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:47 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:47 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 1073741824 Nov 04 22:39:47 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:48 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 1073741824" returned: 0 in 0.493s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:48 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 Nov 04 22:39:48 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:48 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" returned: 0 in 0.269s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0aaa2f-8341-46b0-8a28-247efea05f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbb407c-c1f4-4270-8bfb-bcd785ea96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:48 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Volume volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 (2f3fc4b9-b1f6-47c9-85f7-aa8132af4152): created successfully Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbb407c-c1f4-4270-8bfb-bcd785ea96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:48 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (88231988-0e6d-4339-8e7e-c69a3a569333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:48 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-31eea69f-cce0-43a3-a3f2-c6f15bd72366 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:49 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 83b0f2d8-b9d1-4a6e-ad91-21051199c57d of volume 2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:49 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aaca94-cace-4554-9b5a-3d32d494cf25]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:49 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:49 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 Nov 04 22:39:49 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:50 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" returned: 0 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:50 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d 1G Nov 04 22:39:50 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:50 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d 1G" returned: 0 in 0.380s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:50 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d Nov 04 22:39:50 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:50 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d" returned: 0 in 0.301s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:50 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d is being set with open permissions: ugo+rw Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:50 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d Nov 04 22:39:50 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:50 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d" returned: 0 in 0.235s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:50 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:51 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info Nov 04 22:39:51 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:51 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:51 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info is being set with open permissions: ugo+rw Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:51 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info Nov 04 22:39:51 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:51 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.info" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:51 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-32ff9eff-81ab-4299-a31a-8b5f9bdfeb8e tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-83b0f2d8-b9d1-4a6e-ad91-21051199c57d-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-83b0f2d8-b9d1-4a6e-ad91-21051199c57d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-83b0f2d8-b9d1-4a6e-ad91-21051199c57d" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-83b0f2d8-b9d1-4a6e-ad91-21051199c57d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 83b0f2d8-b9d1-4a6e-ad91-21051199c57d of volume 2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68546d5-8c89-427a-af59-24d8aea14c1b]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:51 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:51 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d Nov 04 22:39:51 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:52 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d" returned: 0 in 0.356s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942afea-8c02-4ae1-b317-da0ef28d1c0e]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:52 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 Nov 04 22:39:52 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:52 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" returned: 0 in 0.344s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:52 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d Nov 04 22:39:52 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:52 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d" returned: 0 in 0.325s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:52 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:52 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d Nov 04 22:39:52 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:53 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152.83b0f2d8-b9d1-4a6e-ad91-21051199c57d" returned: 0 in 0.243s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-83b0f2d8-b9d1-4a6e-ad91-21051199c57d" released by "_delete_snapshot" :: held 1.357s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" released by "delete_snapshot" :: held 1.378s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Created reservations ['686ab66e-4e20-4579-8682-1658ed267b25', '31880e1b-0f1c-4668-98bf-d52786e923d3', '944ac701-008e-4d47-8175-6e77fb82c466', '61a9bd16-de55-46ae-be3f-70b6f98a6b5b'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:53 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-7e499592-ee2f-40d3-8b71-94136e3d9fed tempest-ProjectMemberTests-2093852638 None] Lock "cinder-83b0f2d8-b9d1-4a6e-ad91-21051199c57d-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:53 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[87401f6a-17a1-49cc-8131-90c8e43a9f73]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:54 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 Nov 04 22:39:54 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:54 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" returned: 0 in 0.354s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:54 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152 Nov 04 22:39:54 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:54 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152" released by "delete_volume" :: held 0.659s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Created reservations ['e0eb83df-3d75-4536-bd22-f3985792834f', '56a5f1f5-c167-4737-8336-8466a84e20bb', 'd840b537-757c-47e4-ab90-32b1fe351137', 'b8b44579-a9ff-4b19-af85-a8399d487a95'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:54 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:54 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:54 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:55 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.250s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:55 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-8d3a0a13-aa6b-458a-8bba-a8a266953271 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-2f3fc4b9-b1f6-47c9-85f7-aa8132af4152-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (5259f279-bd84-43d2-a65c-c2bf5866b7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5a74f0-2256-4ef0-af1f-1201cb552be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5a74f0-2256-4ef0-af1f-1201cb552be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420428786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49419e9-a817-4ce8-b93f-4a04021986cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:55Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc4251b-06aa-437c-bcac-423aa0729054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc4251b-06aa-437c-bcac-423aa0729054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a70608-97ea-462e-9631-a554524914ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a70608-97ea-462e-9631-a554524914ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49419e9-a817-4ce8-b93f-4a04021986cd', 'volume_name': 'volume-c49419e9-a817-4ce8-b93f-4a04021986cd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa86857c-940d-4b4e-a9d5-5dc49c60b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa86857c-940d-4b4e-a9d5-5dc49c60b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64a48e0-2f2c-431a-a993-c869970bbdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:55 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Volume c49419e9-a817-4ce8-b93f-4a04021986cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49419e9-a817-4ce8-b93f-4a04021986cd', 'volume_size': 1} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420428786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49419e9-a817-4ce8-b93f-4a04021986cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:39:55Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Creating volume c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:39:55 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:39:55 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:55 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd 1073741824 Nov 04 22:39:55 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:56 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd 1073741824" returned: 0 in 0.397s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:56 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd Nov 04 22:39:56 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:56 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64a48e0-2f2c-431a-a993-c869970bbdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49419e9-a817-4ce8-b93f-4a04021986cd', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7160dbf9-6251-4318-a078-a67054c9bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:39:56 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Volume volume-c49419e9-a817-4ce8-b93f-4a04021986cd (c49419e9-a817-4ce8-b93f-4a04021986cd): created successfully Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7160dbf9-6251-4318-a078-a67054c9bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (5259f279-bd84-43d2-a65c-c2bf5866b7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:39:56 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-71812d98-4793-4842-a6b7-f3df375e23dc tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:56 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:39:56 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 895675d5-a97d-444c-be61-1d806e3f6f01 of volume c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ea8914-aa2f-40d0-beea-d31feba55acc]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:56 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd Nov 04 22:39:56 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:56 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.275s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG oslo_service.periodic_task [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] Running periodic task VolumeManager._thread_info {{(pid=87173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread count: 28 {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 22:39:56 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-8bdb2908-61d0-49d1-b977-b68c27c36158 None None] thread info: [<_MainThread(MainThread, started 127564643176576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 22:39:57 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd" returned: 0 in 0.382s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:57 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 1G Nov 04 22:39:57 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:57 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 1G" returned: 0 in 0.379s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49419e9-a817-4ce8-b93f-4a04021986cd -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:57 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49419e9-a817-4ce8-b93f-4a04021986cd -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 Nov 04 22:39:57 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:57 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49419e9-a817-4ce8-b93f-4a04021986cd -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01" returned: 0 in 0.306s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:57 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 is being set with open permissions: ugo+rw Nov 04 22:39:57 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:57 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 Nov 04 22:39:57 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:58 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:58 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info Nov 04 22:39:58 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:58 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info" returned: 0 in 0.255s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:58 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info is being set with open permissions: ugo+rw Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:58 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info Nov 04 22:39:58 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:58 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.info" returned: 0 in 0.236s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:39:58 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-0c936e12-e280-4629-8665-f5079b63cab6 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-895675d5-a97d-444c-be61-1d806e3f6f01-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-895675d5-a97d-444c-be61-1d806e3f6f01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-895675d5-a97d-444c-be61-1d806e3f6f01" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-895675d5-a97d-444c-be61-1d806e3f6f01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 895675d5-a97d-444c-be61-1d806e3f6f01 of volume c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdbed06-afca-4b68-8895-8ce0f93baefc]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:58 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:59 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 Nov 04 22:39:59 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:59 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01" returned: 0 in 0.353s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c49419e9-a817-4ce8-b93f-4a04021986cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf743b8-8d5c-40f0-ba7f-16bd05c1b9fc]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:59 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd Nov 04 22:39:59 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:59 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd" returned: 0 in 0.338s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:59 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 Nov 04 22:39:59 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:39:59 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01" returned: 0 in 0.329s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:39:59 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:39:59 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01 Nov 04 22:39:59 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:00 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd.895675d5-a97d-444c-be61-1d806e3f6f01" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-895675d5-a97d-444c-be61-1d806e3f6f01" released by "_delete_snapshot" :: held 1.349s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" released by "delete_snapshot" :: held 1.371s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Created reservations ['ee596150-2533-417b-a19c-a4f60edc29c1', '65dc060a-8cf1-4725-a8bf-427a3ae32767', '07bb0187-a890-4c08-aa73-58590f83659a', 'c9babe0e-d2bc-4035-892d-f47f0432a217'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:00 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-936fc4d2-732a-4d52-aebe-ce1fb85b2483 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-895675d5-a97d-444c-be61-1d806e3f6f01-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-c49419e9-a817-4ce8-b93f-4a04021986cd-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:00 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-c49419e9-a817-4ce8-b93f-4a04021986cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8a750-a691-48d8-8606-855d96bead85]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:01 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd Nov 04 22:40:01 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:01 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:01 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd Nov 04 22:40:01 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:01 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-c49419e9-a817-4ce8-b93f-4a04021986cd" returned: 0 in 0.261s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-c49419e9-a817-4ce8-b93f-4a04021986cd" released by "delete_volume" :: held 0.695s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Created reservations ['c8f3b393-aed9-4c84-82ed-ea4166a57465', '3a79331e-505d-4fc1-91c2-e30db942e5dd', '0e5a8fbe-789d-45eb-8eab-005e9b58f34b', 'b416f4eb-ee9a-4291-a44a-be75e769d7be'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:01 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:01 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:40:01 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:02 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.252s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:40:02 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-837aa64f-fc11-41e1-b78a-77dc66565207 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-c49419e9-a817-4ce8-b93f-4a04021986cd-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (2ed690b6-b986-4d68-83da-c3587954ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d353bdc-a00c-4767-918e-0db0ba210e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d353bdc-a00c-4767-918e-0db0ba210e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194878437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd10de9-4544-4877-98cf-c23facba485f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:03Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6564e-1187-4acc-9aed-237ef4a75679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6564e-1187-4acc-9aed-237ef4a75679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63341f9c-0153-4357-9034-4b968f070439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63341f9c-0153-4357-9034-4b968f070439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd10de9-4544-4877-98cf-c23facba485f', 'volume_name': 'volume-7dd10de9-4544-4877-98cf-c23facba485f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba06436-7b6a-40cb-b7ff-1d9b2a6329dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba06436-7b6a-40cb-b7ff-1d9b2a6329dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9557ad2-ae66-41fc-a205-f99287492cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:02 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Volume 7dd10de9-4544-4877-98cf-c23facba485f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd10de9-4544-4877-98cf-c23facba485f', 'volume_size': 1} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194878437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd10de9-4544-4877-98cf-c23facba485f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:03Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Creating volume 7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:40:02 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:40:02 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:02 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f 1073741824 Nov 04 22:40:02 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:03 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f 1073741824" returned: 0 in 0.402s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:03 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f Nov 04 22:40:03 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:03 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f" returned: 0 in 0.248s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9557ad2-ae66-41fc-a205-f99287492cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd10de9-4544-4877-98cf-c23facba485f', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22099256-b843-4b18-9a45-7c0ce8d5f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:03 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Volume volume-7dd10de9-4544-4877-98cf-c23facba485f (7dd10de9-4544-4877-98cf-c23facba485f): created successfully Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22099256-b843-4b18-9a45-7c0ce8d5f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (2ed690b6-b986-4d68-83da-c3587954ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:03 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-fdb0c2e5-69de-4b5b-8692-c762c87c0a44 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 65eeb946-34eb-4476-9ee6-e5d524e237ef of volume 7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[12193214-a333-475d-b917-abe7f75b89be]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:03 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:03 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f Nov 04 22:40:03 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:04 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f" returned: 0 in 0.401s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:04 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef 1G Nov 04 22:40:04 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:04 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef 1G" returned: 0 in 0.383s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd10de9-4544-4877-98cf-c23facba485f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:04 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd10de9-4544-4877-98cf-c23facba485f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef Nov 04 22:40:04 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:04 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd10de9-4544-4877-98cf-c23facba485f -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef" returned: 0 in 0.283s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:04 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef is being set with open permissions: ugo+rw Nov 04 22:40:04 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:04 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef Nov 04 22:40:04 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:05 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:05 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info Nov 04 22:40:05 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:05 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info" returned: 0 in 0.252s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:05 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info is being set with open permissions: ugo+rw Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:05 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info Nov 04 22:40:05 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:05 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.info" returned: 0 in 0.251s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:05 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a99c4238-d589-4ef2-baa7-b3da4af88d4b tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-65eeb946-34eb-4476-9ee6-e5d524e237ef-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-65eeb946-34eb-4476-9ee6-e5d524e237ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-65eeb946-34eb-4476-9ee6-e5d524e237ef" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-65eeb946-34eb-4476-9ee6-e5d524e237ef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 65eeb946-34eb-4476-9ee6-e5d524e237ef of volume 7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c313849-4b24-4752-83bf-3e14706855e5]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:05 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:06 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef Nov 04 22:40:06 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:06 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef" returned: 0 in 0.355s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd10de9-4544-4877-98cf-c23facba485f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[d124e81b-17ac-469a-8a22-c326ce8b325a]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:06 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f Nov 04 22:40:06 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:06 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f" returned: 0 in 0.348s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:06 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef Nov 04 22:40:06 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:06 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef" returned: 0 in 0.330s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:06 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:07 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef Nov 04 22:40:07 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:07 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f.65eeb946-34eb-4476-9ee6-e5d524e237ef" returned: 0 in 0.249s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-65eeb946-34eb-4476-9ee6-e5d524e237ef" released by "_delete_snapshot" :: held 1.374s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" released by "delete_snapshot" :: held 1.396s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Created reservations ['d0e2478a-d6e7-47e1-96c6-b689549aa2a9', 'beed12a3-43ae-4c15-9f45-73cd202008f1', '95a2d10e-0071-4c97-82b9-a8e55a7619fc', '30c6f687-c9b0-46d5-91f2-58185e2d8704'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:07 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-45070954-f620-4a11-8725-704419788f4e tempest-ProjectMemberTests-2093852638 None] Lock "cinder-65eeb946-34eb-4476-9ee6-e5d524e237ef-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:07 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-7dd10de9-4544-4877-98cf-c23facba485f-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-7dd10de9-4544-4877-98cf-c23facba485f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" acquired by "delete_volume" :: waited 0.016s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e68b7-8607-4d58-9f2a-69abcd458948]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:08 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f Nov 04 22:40:08 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:08 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f" returned: 0 in 0.363s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:08 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f Nov 04 22:40:08 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:08 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-7dd10de9-4544-4877-98cf-c23facba485f" returned: 0 in 0.244s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-7dd10de9-4544-4877-98cf-c23facba485f" released by "delete_volume" :: held 0.671s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Created reservations ['30550110-a7d7-4c95-be81-1c663d2d98f1', '838bda08-849a-4f38-98c8-6f1b72837518', '1d729e2e-f54f-4a57-b61d-3fd3d10b47dd', '0476f6ef-541f-48b3-a915-4ae3d43f4009'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:08 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:08 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:40:08 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:09 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.253s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:40:09 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-e12a4c5d-7b04-439e-8e01-75ebbb00e9f7 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-7dd10de9-4544-4877-98cf-c23facba485f-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (a36bf3c1-cc97-487e-81a7-9966c1d0f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f08391-b8cc-4f98-bd96-2401f6ef338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f08391-b8cc-4f98-bd96-2401f6ef338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003580626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee34594-d5a5-499e-959b-d9e69bad756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:10Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de252f16-e578-4838-8624-25e2a84e5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de252f16-e578-4838-8624-25e2a84e5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b781e5-cb41-4985-9816-2a4575fe6d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b781e5-cb41-4985-9816-2a4575fe6d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee34594-d5a5-499e-959b-d9e69bad756e', 'volume_name': 'volume-8ee34594-d5a5-499e-959b-d9e69bad756e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be357d0-1437-492b-b7a0-a5327e11c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be357d0-1437-492b-b7a0-a5327e11c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd57f3c-8e96-4899-bade-e113010c2fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:09 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Volume 8ee34594-d5a5-499e-959b-d9e69bad756e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee34594-d5a5-499e-959b-d9e69bad756e', 'volume_size': 1} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003580626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee34594-d5a5-499e-959b-d9e69bad756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:10Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Creating volume 8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:40:09 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:40:09 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:09 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e 1073741824 Nov 04 22:40:09 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:10 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e 1073741824" returned: 0 in 0.411s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:10 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e Nov 04 22:40:10 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:10 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd57f3c-8e96-4899-bade-e113010c2fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee34594-d5a5-499e-959b-d9e69bad756e', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d85f9-d5e8-4845-8f08-96e4c64d5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:10 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Volume volume-8ee34594-d5a5-499e-959b-d9e69bad756e (8ee34594-d5a5-499e-959b-d9e69bad756e): created successfully Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d85f9-d5e8-4845-8f08-96e4c64d5b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (a36bf3c1-cc97-487e-81a7-9966c1d0f24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:10 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-a8d716a7-5f00-41c8-ab48-1a07b0b0c339 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot f08c3c42-dfa4-46e3-9802-74cad31b5807 of volume 8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f2c5b-f69e-4e30-affa-9cab25362b45]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:10 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:10 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e Nov 04 22:40:10 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:11 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e" returned: 0 in 0.366s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:11 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 1G Nov 04 22:40:11 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:11 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 1G" returned: 0 in 0.384s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee34594-d5a5-499e-959b-d9e69bad756e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:11 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee34594-d5a5-499e-959b-d9e69bad756e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 Nov 04 22:40:11 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:11 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee34594-d5a5-499e-959b-d9e69bad756e -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807" returned: 0 in 0.281s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:11 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 is being set with open permissions: ugo+rw Nov 04 22:40:11 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:11 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 Nov 04 22:40:11 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:12 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807" returned: 0 in 0.234s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:12 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info Nov 04 22:40:12 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:12 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:12 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info is being set with open permissions: ugo+rw Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:12 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info Nov 04 22:40:12 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:12 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.info" returned: 0 in 0.241s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:12 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-ee072897-e986-4943-aecd-8a20fd52cf94 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-f08c3c42-dfa4-46e3-9802-74cad31b5807-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-f08c3c42-dfa4-46e3-9802-74cad31b5807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-f08c3c42-dfa4-46e3-9802-74cad31b5807" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-f08c3c42-dfa4-46e3-9802-74cad31b5807" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot f08c3c42-dfa4-46e3-9802-74cad31b5807 of volume 8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[034c92e7-92ca-4705-b29e-df4f0b94f0b1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:12 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:13 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 Nov 04 22:40:13 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:13 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807" returned: 0 in 0.352s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ee34594-d5a5-499e-959b-d9e69bad756e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc6822a-9d0e-4e21-bf40-9989090e3427]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:13 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e Nov 04 22:40:13 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:13 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e" returned: 0 in 0.342s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:13 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:13 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 Nov 04 22:40:13 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:14 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807" returned: 0 in 0.339s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:14 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807 Nov 04 22:40:14 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:14 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e.f08c3c42-dfa4-46e3-9802-74cad31b5807" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-f08c3c42-dfa4-46e3-9802-74cad31b5807" released by "_delete_snapshot" :: held 1.397s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" released by "delete_snapshot" :: held 1.424s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Created reservations ['3150fe11-f446-49b2-ab20-48aba4b97c64', '1a20c325-2861-4fbf-bce0-4ea21825c0f4', 'e77cfb5e-1ffa-487e-8f30-49a5997b7360', 'c5c147b8-977b-4986-ba28-f067a859c4ac'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:14 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:40:14 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-384684ec-3e21-42e6-8b82-cb6dbaca0cea tempest-ProjectMemberTests-2093852638 None] Lock "cinder-f08c3c42-dfa4-46e3-9802-74cad31b5807-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-8ee34594-d5a5-499e-959b-d9e69bad756e-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-8ee34594-d5a5-499e-959b-d9e69bad756e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" acquired by "delete_volume" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[117cdd28-e86c-40d8-98ab-9405ad8831b6]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:15 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e Nov 04 22:40:15 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:15 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e" returned: 0 in 0.364s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:15 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e Nov 04 22:40:15 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:15 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8ee34594-d5a5-499e-959b-d9e69bad756e" returned: 0 in 0.257s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8ee34594-d5a5-499e-959b-d9e69bad756e" released by "delete_volume" :: held 0.678s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Created reservations ['293bcb9a-fcce-49fa-8874-f6299c8414ea', '891d05be-f9c5-4f16-92b8-f6b672d07b4f', 'e15b7be0-bebe-473f-8547-3e988321e898', '76018439-10c2-457c-a263-85718a691118'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:15 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:15 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:40:15 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:16 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.267s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:40:16 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-5faf3a6e-958f-4a1a-bb96-959f8057e2f4 tempest-ProjectMemberTests-2093852638 None] Lock "cinder-8ee34594-d5a5-499e-959b-d9e69bad756e-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (259d6476-391d-4543-9bd2-120f43257eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e8d5d-a465-4403-a1e6-f0dab6c944b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e8d5d-a465-4403-a1e6-f0dab6c944b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-375680723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d92dd94-48ac-453e-819a-ce40419cb4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:17Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996200f7-23ea-4fb9-8b00-48334788d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996200f7-23ea-4fb9-8b00-48334788d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5068bb5-1405-4f28-a822-151694737d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5068bb5-1405-4f28-a822-151694737d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d92dd94-48ac-453e-819a-ce40419cb4b7', 'volume_name': 'volume-8d92dd94-48ac-453e-819a-ce40419cb4b7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb023d4f-0c4a-4200-9726-e21bb186a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb023d4f-0c4a-4200-9726-e21bb186a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51959389-bf25-45b5-a396-96eb46ea1c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:16 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Volume 8d92dd94-48ac-453e-819a-ce40419cb4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d92dd94-48ac-453e-819a-ce40419cb4b7', 'volume_size': 1} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T21:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-375680723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d92dd94-48ac-453e-819a-ce40419cb4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8036d098b4561b5928a3f7ce1146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T21:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T21:40:17Z,use_quota=True,user_id='589baf1ab10941438a0cd5d588a5401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c0d1b9f-99f5-4afc-972f-995eee4a322b),volume_type_id=3c0d1b9f-99f5-4afc-972f-995eee4a322b)}" {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Creating volume 8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 as target Quobyte volume. {{(pid=87173) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 22:40:16 devstack cinder-volume[87173]: INFO cinder.volume.drivers.remotefs [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1 Nov 04 22:40:16 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 1073741824 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:16 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 1073741824 Nov 04 22:40:16 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:17 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 1073741824" returned: 0 in 0.412s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:17 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 Nov 04 22:40:17 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:17 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7" returned: 0 in 0.236s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'} {{(pid=87173) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51959389-bf25-45b5-a396-96eb46ea1c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d92dd94-48ac-453e-819a-ce40419cb4b7', 'volume_size': 1}' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7117b6-1a5a-401f-bfa5-358be54a0b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 22:40:17 devstack cinder-volume[87173]: INFO cinder.volume.flows.manager.create_volume [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Volume volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 (8d92dd94-48ac-453e-819a-ce40419cb4b7): created successfully Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7117b6-1a5a-401f-bfa5-358be54a0b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87173) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Flow 'volume_create_manager' (259d6476-391d-4543-9bd2-120f43257eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87173) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 22:40:17 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-e0ae66c6-34b2-4395-9d2f-dbc65ce0f0d4 tempest-ProjectMemberTests-2093852638 None] Created volume successfully. Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Creating offline snapshot 1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c of volume 8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57fda46-8af0-4ca6-90c0-fe26d7ec25b9]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:17 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:17 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 Nov 04 22:40:17 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:18 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7" returned: 0 in 0.358s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c 1G {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:18 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c 1G Nov 04 22:40:18 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:18 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c 1G" returned: 0 in 0.374s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:18 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c Nov 04 22:40:18 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:18 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 -F qcow2 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" returned: 0 in 0.289s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:18 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c is being set with open permissions: ugo+rw Nov 04 22:40:18 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:18 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c Nov 04 22:40:18 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:19 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" returned: 0 in 0.239s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:19 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info Nov 04 22:40:19 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:19 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info" returned: 0 in 0.240s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:19 devstack cinder-volume[87173]: WARNING cinder.volume.drivers.remotefs [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info is being set with open permissions: ugo+rw Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:19 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info Nov 04 22:40:19 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:19 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.info" returned: 0 in 0.237s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:19 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:19 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-84ba6b75-154c-48a0-bf99-a29d1a5c4193 tempest-ProjectMemberTests-2093852638 None] Create snapshot completed successfully Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c-delete_snapshot" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" by "delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" by "_delete_snapshot" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Deleting offline snapshot 1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c of volume 8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] snapshot_file for this snap is: volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6ccc6-b931-4650-a2a1-e86284d724f7]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:20 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c Nov 04 22:40:20 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:20 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" returned: 0 in 0.359s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.remotefs [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d92dd94-48ac-453e-819a-ce40419cb4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87173) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6fdd4-af15-4c08-8cda-baa589a79aa1]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:20 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 Nov 04 22:40:20 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:20 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7" returned: 0 in 0.349s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:20 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:20 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c Nov 04 22:40:20 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:21 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" returned: 0 in 0.324s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:21 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c Nov 04 22:40:21 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:21 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7.1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" returned: 0 in 0.230s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c" released by "_delete_snapshot" :: held 1.357s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" released by "delete_snapshot" :: held 1.378s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Created reservations ['969b2a72-4fa1-48da-aa81-f0e069ebf4fe', '0382fae9-dc63-4c91-ba86-8de58c2db041', 'e4ea6868-444a-4111-b1d9-92d60e8b890e', '19166907-906b-4a4a-aed9-00516f703d68'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:21 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Delete snapshot completed successfully. Nov 04 22:40:21 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-68c9f8dd-134f-46de-b4d0-ce6012b3e7aa tempest-ProjectMemberTests-2093852638 None] Lock "cinder-1e8d0234-bc92-4ee0-a5b7-8b2e914bfc7c-delete_snapshot" released by "delete_snapshot" :: held 1.497s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-8d92dd94-48ac-453e-819a-ce40419cb4b7-delete_volume" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "cinder-8d92dd94-48ac-453e-819a-ce40419cb4b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Acquiring lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" by "delete_volume" {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" acquired by "delete_volume" :: waited 0.014s {{(pid=87173) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo.privsep.daemon [-] privsep: reply[43576e98-beb6-41df-af28-c122c26aafb0]: (4, 'qcow2') {{(pid=88792) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:22 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 Nov 04 22:40:22 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:22 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7" returned: 0 in 0.355s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:22 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7 Nov 04 22:40:22 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:22 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2/volume-8d92dd94-48ac-453e-819a-ce40419cb4b7" returned: 0 in 0.246s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "cinder-quobyte-8d92dd94-48ac-453e-819a-ce40419cb4b7" released by "delete_volume" :: held 0.660s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.quota [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Created reservations ['3ab8f78b-28b4-4768-9499-192c02231d16', '9d24e9df-7995-4e21-9806-a79009838748', 'd21496bb-5092-4f7e-ace7-82a0b20ca511', '54b38a33-6979-41fb-8ccc-50cf789a2940'] {{(pid=87173) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 22:40:22 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1': None} {{(pid=87173) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG cinder.volume.drivers.quobyte [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a7e69b9-8e2e-4d5b-8cc9-0c57508fa1c1'] {{(pid=87173) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.lockutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87173) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 22:40:23 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2 Nov 04 22:40:23 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 22:40:23 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG oslo_concurrency.processutils [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bf1b833330a0b5298eda6691f30211a2" returned: 0 in 0.238s {{(pid=87173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG cinder.manager [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Notifying Schedulers of capabilities ... {{(pid=87173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 22:40:23 devstack cinder-volume[87173]: INFO cinder.volume.manager [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Deleted volume successfully. Nov 04 22:40:23 devstack cinder-volume[87173]: DEBUG cinder.coordination [None req-67bd02c1-4e61-4e5f-a885-4b039e76b00b tempest-ProjectMemberTests-2093852638 None] Lock "cinder-8d92dd94-48ac-453e-819a-ce40419cb4b7-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87173) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 22:40:32 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:SELECT=147,cinder:INSERT=53,cinder:UPDATE=191,cinder:DELETE=17 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 22:40:33 devstack cinder-volume[87173]: DEBUG dbcounter [-] [87173] Writing DB stats cinder:INSERT=45,cinder:UPDATE=177,cinder:SELECT=123,cinder:DELETE=13 {{(pid=87173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}